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li.  INTRODUCTION 

The  research  to  be  conducted  over  the  four  year  period  of  this  contract  centers  around  three  areas  1) 
expansion  of  chnical  trials  capabilities  performed  under  an  ongoing  NIH  grant  and  their  continuation  after 
those  trials  are  completed;  2)  image  registration  using  the  mutual  information  cost  function  for 
evaluation/demonstration  of  image  compounding  and  sequential  examinations;  3)  approaches  to  real  time 
image-based  slice  positioning;  4)  the,  as  yet,  unique  effort  to  image  lactic  ducts  in  3D  and  perform 
preliminary  evaluation  of  their  diagnostic  potential.  Most  of  the  research  will  be  performed  in  parallel  by 
various  investigators.  The  following  time  line  for  the  second  and  third  years  was  given  in  the  funded  scope 
of  work. 


Table  1.  Time  Line  for  Present  and  Next  Project  Periods 

Year  2 

Year  3 

Clinical  Trials 

Validation/improvement  of  vascularity  measures 

-1-  + 

Chnical  Trials  of  ~30  subjects 

+  + 

-  +  -  + 

Trials  data  analysis  and  write-up 

Compound  and  Sequential  Imaging 

Develop  automated  image  registration  by  mutual  information 

+  -+  - 

+  -+  - 

Process  ultrasound  images  to  evaluate/demonstrate  compound  and 
sequential*  imaging  therewith 

+ 

Image-based  Slice  Positioning  [IBaR] 

Real  time  speckle  decorrelation  for  image  plane  positioning 

-  -  -  - 

“  + 

Digital  ductography  development 

+  + 

+  + 

Ductographic  analysis  of  selected  clinical  trial  cases 

+  + 

*  Auto  registration  of  breast  images  from  multiple  exams  +  =  concentrated  effort  -  =  modest  effort 


The  following  series  of  deUverables  and  associated  materials  are  included  in  this  annual  progress  report. 
Included  are  a  listing  of  papers,  abstracts  and  manuscripts,  published  and  submitted. 

Year  02 

Item  1:  Summary  report  of  clinical  trials  conducted  in  the  second  year. 

Item  2:  Interim  report  on  image  processing  for  auto-registration  in  compound  imaging. 

Item  3:  Report  on  improvement  and  validation  of  vascularity  measures. 

III.  BODY 

Progress  has  been  made  in  the  four  areas  of  emphasis  of  this  grant  as  listed  below. 

A.  Clinical  Trials  and  Vascularity  Measures 

1.  Report  on  Validation/improvement  of  vascularity  measures  (Deliverable  Item  3.) 

Several  advances  have  been  made  in  validation/improvement  of  vascularity  measures.  We  implemented 
the  automated  measurement  technique  for  normalizing  power  mode  blood  signal  measures  in  3D  data  sets 
(Reference/Appendix  ##3)  and  have  applied  it  to  available  patient  data  with  promising  results.  (Deliverable 
Item  3.) 
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2.  Summary  Report  on  Clinical  Trials  (Deliverable  Item  1.) 

Because  of  demands  for  the  patients  by  other  grants  and  technique  startup,  we  have  done  only  six  patients 
using  the  latest  apparatus  including  the  1.5  D  matrix  array  scanhead.  However  some  of  the  competing  grants 
are  winding  down  and  the  rate  will  accelerate  dramatically  in  the  second  half  of  year  3  and  be  continued  into 
year  4.  This  delay  is  more  than  offset  by  accomplishments  ahead  of  schedule  in  sequential  imaging  and 
image-based  slice  positioning. 

3.  Trials  data  analysis  and  write-up 

Analysis  of  quantitative  vascularity  results  from  previous  trials  was  conducted  in  part  under  this  grant, 
resulting  in  a  second  publication,  Reference/Appendix  5.  This  contract  also  contributed  modestly  to  a 
submission  on  clinical  trials  methods  and  preliminary  results,  Reference/Appendix  8. 

B.  Interim  Report  on  Image  Processing  for  Auto-registration  in  Compound  and 
Sequential  Imaging 

The  most  exciting  advances  with  the  greatest  long  term  significance  again  involve  the  automatic 
registration  of  two  or  more  3D  image  sets  to  add  to  the  information  and  quality  of  the  resulting  set  or  to 
demonstrate  changes  between  two  sets.  (Deliverable  Item  2.) 

1.  Develop  automated  image  registration  by  mutual  information 

The  software  developed  here,  MIAMI  Fuse,  has  been  further  refined  and  employed  now  by  a  variety  of 
users.  The  first  demonstrated  3D  coregistrations  of  ultrasound  image  sets  are  reported  in  Reference/Appendix 
3. 


2.  Process  ultrasound  images  to  evaluate/demonstrate  compound  and  sequential  imaging 
therewith 

The  software  has  been  modified  and  the  registration  is  now  being  applied  routinely  on  patient  examples 
for  demonstration  of  each  of  several  uses,  including:  1)  tracking  changes  for  patients  undergoing 
chemotherapy  and  antiangiogenesis  therapy;  2)  highlighting  and  quantifying  changes  in  normal  or  suspicious 
breasts  as  a  prelude  to  improved  detection  of  preclinical  disease;  3)  combining  3D  data  sets  from  various 
ultrasound  imaging  modes  to  properly  register  the  unique  information  provided  by  each;  4)  demonstrating 
tissue  mechanical  properties  by  their  motion  during  manipulation;  5)  expanding  the  field  of  view  by 
combining  several  partially-overlapping  3D  scans  to  see  the  full  volume  of  medium  to  large  lesions  and 
reasonable  amounts  of  surrounding  vascular  morphology  and  to  show  a  reasonable  volume  of  the  breast  for 
tracking  difficult  areas  of  the  breast  in  follow-up  studies;  6)  combining  views  from  multiple  angles 
(compounding).  Use  types  1)  and  3)  are  illustrated  in  Fig.  1  and  use  5)  is  illustrated  in  Fig.  2.  AH  but  the 
compounding  examples  are  outstanding,  leading  to  a  new  approach  to  following  the  high  risk  or  difficult 
cases.  Compounding  examples  are  promising,  but  considerably  more  work  is  needed.  Compounding  is  the 
subject  of  our  longer  term  efforts  through  the  planned  thesis  of  one  of  our  promising  Ph.D.  candidates. 
Several  examples  illustrating  these  concepts  are  in  a  submitted  electronic  journal  manuscript 
(Reference/Appendix  2)  available  confidentially  for  reviewers  of  this  report  on  the  web  at 
http://deepred.rad.med.umich.edu/previews/index.html.  Use  as  an  ID  -  “Reviewer”  and  the  password  - 
“3DBreast”.  This  was  part  of  a  manuscript  submitted  in  year  02  and  now  split  into  two  parts  in  year  03. 

C.  Real  Time  Image-based  Registration  of  Slice  Position  [IBaR] 

1.  Real  time  speckle  decorrelation  for  image  plane  positioning 

Considerable  progress  has  been  made  in  IBaR  and  real  time  implementation  thereof.  See,  for  example 
Fig.  8  in  Reference/Appendix  1  for  evidence  of  successful  image-based  scan  separation  registration  in  actual 
breast  images.  With  our  direct  help,  one  company  has  implemented  portions  of  this  technique  in  real  time. 
This  progress  will  be  reported  more  folly  in  the  year  03  summary  report. 
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D.  Digital  ductography  development 


1.  Ductographic  analysis  of  selected  clinical  trial  cases 

Results  of  part  of  this  work  were  reported  at  two  meetings  in  late  1997  (9, 10).  The  many  other  abstracts 
of  presentations  related  to  this  grant  are  not  listed,  as  they  are  generally  covered  by  the  manuscripts  included. 


E.  Figures 


Fig.  1  Coregistered  and  superimposed 
power  mode  images  of  two  sequential 
scans,  obtained  4  weeks  apart  in  a  patient 
undergoing  chemotherapy.  The  left  half 
of  the  gray  scale  background  is  taken 
from  the  first  scan,  the  right  half  from  the 
second  scan.  The  surface-rendered 
vascularity  in  the  first  and  second  scans 
are  displayed  throughout  the  volume  in 
medium  gray  and  white,  respectively. 
Note  the  strong  reduction  in  vascularity 
(gray  to  white),  along  with  a  less 
pronounced  reduction  in  the  lesion 
volume  (left  to  right). 


Fig.  2  3D  view  of  a  volume 
combined  from  three 
parallel,  partly  overlapping 
scans  in  a  65  year  old  female 
with  invasive  ductal 
carcinoma. 

The  total  width  of  this 
extended  view  is  7.9  cm. 
The  boundaries  between  the 
original  scans  at  about  one 
third  and  two  thirds  of  the 
width  of  the  composite 
image  (black  arrows)  are 
hardly  noticeable. 
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IV.  CONCLUSIONS 

The  advances  described  above  should  increase  the  sensitivity  and  specificity  of  ultrasound  imaging  in 
discriminating  benign  from  malignant  known  masses.  Increasingly  we  and  others  will  look  toward  expanded 
roles  in  the  young  and  mammographically  dense  breast  and  in  detection  of  cancers  on  follow-up  studies  and 
in  high  risk,  preclinical  disease. 

Clinical  Trials 

Preliminary  data  analysis  and  write-up  has  been  completed  on  new  trials  and  contributions  were  made  to 
advance  3D  image  acquisition,  display  and  quantification. 

Compound  and  Sequential  Imaging 

The  registration  achieved  so  far  is  unexpectedly  good  and  robust.  It  has  promise  for  an  increasing 
number  of  applications  that  could  revolutionize  the  use  of  ultrasound  in  medicine,  particularly  for  seri^ 
studies.  The  types  of  serial  exams  that  might  be  followed  include  tracking  of  tumor  size  and  vascularity  for 
early  indications  of  response  to  treatment,  as  well  as  serial  follow-up  or  even  screening  exams  to  reveal 
abnormal  growth.  Our  new  extended  3D  field  of  view  imaging  appears  to  greatly  increase  the  changes  of 
achieving  these  goals. 

Image-based  Slice  Positioning  [IBaR] 

The  results  to  date  continue  to  be  impressive,  and  at  least  two  companies  have  implemented  aspects  of  the 
technique,  one  with  clear  acknowledgement  of  our  developments. 

Digital  ductography  development 

The  technique  has  been  illustrated  in  concept,  but  much  more  work  will  be  required  to  show  practical, 
routine  utility. 
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In  three-dimensional  ultrasonography 
(US),  the  position  accuracy  of  each  B-scan 
frame  is  essential  for  accurate  volume 
reconstruction.  Even  for  qualitative  recon¬ 
struction  without  position  measurement, 
the  image  spacing  must  be  adequately 
fine  and  uniform  to  avoid  streak  artifacts. 
Cunent  position  measurement  tech¬ 
niques  require  use  of  a  supplementary 
mechanic^  device  to  record  the  location 
of  the  transducer  head  during  scaiming. 
We  propose  an  alternative  scheme  that 
makes  use  of  the  residual  correlation  be¬ 
tween  frames  to  estimate  the  separation 
distance.  Since  the  observed  speckle  pat¬ 
terns  are  wholly  determined  by  the  physi¬ 
cal  properties  of  the  transducer-given  scat¬ 
tering  dominated  by  a  large  number  of 
random  scatterers  in  the  insonified  vol¬ 
ume,  the  frame  separation  can  be  com¬ 
puted  from  the  degree  of  speckle  decorre¬ 
lation  as  calibrated  for  a  specific  trans¬ 
ducer. 

In  recent  years,  reconstruction  of  three- 
dimensional  US  scans  for  potential  clini¬ 
cal  use  has  demonstrated  moderate  suc¬ 


cess  in  areas  such  as  breast  cancer 
diagnosis  (1),  angiography  (2),  fetal 
anomalies  (3),  and  prosthesis  modeling 
(4).  Traditionally,  for  accurate  three- 
dimensional  rendering  (5),  the  trans¬ 
ducer  orientation  had  to  be  determined 
with  use  of  an  articulated  arm,  microcon- 
trolled  motor-driven  translator,  or  electro¬ 
magnetic  positioner  or  by  means  of  opti¬ 
cal  imaging.  By  computing  frame  spacing 
directly  from  the  image  series,  the  hard¬ 
ware  necessary  for  the  scanning  process  is 
greatly  reduced.  The  ultimate  result  of 
techniques  that  examine  image  correla¬ 
tion  would,  then,  be  image-based  registra¬ 
tion  of  B  scans  obtained  with  a  freely 
moving,  handheld  transducer. 

In  previous  work,  Chen  et  al  (6,7)  intro¬ 
duced  the  concept  of  monitoring  of  scan¬ 
ning  plane  motion  by  means  of  changes 
in  speckle  conelation  in  the  elevational 
direction.  Their  deconelation  curves  were 
computed  from  a  small  set  of  training 
images  and  were  valid  only  within  the 
focal  zone.  In  this  study,  the  transducer 
was  calibrated  to  determine  a  depth- 
dependent  beam  correlation  width  to  al¬ 
low  analysis  over  a  larger  scanning  re¬ 
gion.  An  automated  adaptive  speckle 
detector  was  also  employed  to  ensure 
only  true  speckle  areas  were  included  in 
the  estimate.  The  current  technology  (8,9) 
could  then  provide  three-dimensional  re- 
constmction  with  use  of  real-time  imag¬ 
ing  and  freehand  scanning. 

I  Materials  and  Methods 

The  rate  of  speckle  decorrelation  can  be 
derived  by  means  of  statistical  analysis  of 
speckle  formation.  A  more  detailed  deriva¬ 
tion  is  given  in  the  Appendix,  but  the 
main  points  and  assumptions  are  pre¬ 
sented  here.  For  fully  developed  speckle, 
the  intensity  image  should  have  an  expo¬ 
nential  distribution  and  a  constant  ratio 
of  mean  to  standard  deviation  of  1.0.  The 
amount  of  speckle  change  from  frame  to 
frame  is  directly  related  to  the  second- 
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order  statistics  as  determined  by  the  frame 
separation.  Note  that  in  this  analysis,  the 
normalized  autocovariance  is  referred  to 
as  the  conelation  function. 

The  algorithm  derivation  shows  that 
the  intensity  correlation  function  is  di¬ 
rectly  related  to  the  amplitude  correla¬ 
tion  function,  which  in  turn  is  propor¬ 
tional  to  the  point-spread-function 
autocorrelation.  Assuming  a  focused 
transducer,  the  beam  pattern  can  then  be 
approximated  by  means  of  a  Gaussian 
curve  that  has  a  depth-dependent  width 
as  the  beam  goes  in  and  out  of  the  focal 
region.  Consequently,  the  intensity  auto¬ 
correlation  can  also  be  written  as  a  Gauss¬ 
ian  function  with  respect  to  the  frame 
spacing  and  will  have  a  SD  of  the 
depth-dependent  beam  correlation  width. 
This  correlation  width  in  the  focus  can  be 
calculated  on  the  basis  of  the  transducer's 
physical  properties,  or  the  conelation 
width  for  a  longer  range  can  be  calibrated 
by  using  a  speckle  phantom.  The  final 
result  is  that  by  means  of  Gaussian  curve 
fitting  of  the  correlation  function  for 
speckle  regions  in  a  set  of  B-scan  frames, 
the  average  frame  spacing  for  that  set  can 
be  back  calculated. 

In  this  study,  a  commercially  available 
US  scanner  (LOGIQ  700;  GE  Medical  Sys¬ 
tems,  Milwaukee,  Wis)  was  used,  with  a 
13-MHz,  1.5-dimensional  matrix  linear  ar¬ 
ray  probe.  The  transducer  had  a  6-dB  lateral 
beam  width  of  1.9  mm  and  an  elevational 
beam  width  of  2.0  mm  at  the  focus.  B-scan 
images  were  obtained  with  both  uniformly 
and  nonuniformly  spaced  elevation^ 


sweeps.  The  scans  were  digitized  to  8  bits 
and  stored  as  379  x  380-pixel  images,  corre¬ 
sponding  to  4-cm2  regions.  The  recorded 
gray-scale  images  were  then  log  decom¬ 
pressed  to  obtain  an  intensity  image  series. 

Since  the  decorrelation  algorithm  holds 
true  for  only  speckle  regions,  a  speckle 
"detector"  based  on  first-order  statistics 
was  developed.  The  ratio  of  mean  inten¬ 
sity  to  SD  was  computed  for  a  region  with 
a  moving  three-dimensional  volume 
(21  X  21  pixels  X  10  frames).  A  binary 
mask  was  formed  that  displayed  regions 
in  which  the  ratio  of  mean  intensity  to 
SD  was  between  0.9  and  1.1,  and  the 
two-dimensional  mask  was  assigned  to 
the  center  frame.  Pixels  in  only  the  mask 
region  were  then  used  to  form  the  aver¬ 
age  covariance  function. 

The  depth-dependent  beam  correla¬ 
tion  width  of  the  transducer  was  deter¬ 
mined  by  using  a  focal  lesion  phantom 
(CIRS;  Computerized  Imaging  Reference 
Systems,  Norfolk,  Va).  The  phantom, 
which  has  a  densely  packed,  random 
distribution  of  fine  particles,  provided 
the  minimum  number  of  scatterers  in  the 
resolution  cell  necessary  to  create  fully 
developed  speckle.  The  transducer  was 
affixed  to  a  linear  micropositioner,  and 
120  B-scan  images  were  obtained  in  an 
elevational  sweep,  with  a  uniform  step 
size  of  50.8  (im.  Wth  a  moving  volume  of 
10  frames,  a  mask  was  determined  for  the 
central  portion  of  the  scans,  a  region  of 
300  X  100  pixels.  The  average  autocovari¬ 
ance  was  computed  for  each  row  in  the 
mask,  normalized,  and  then  Gaussian 


curve  fitted.  The  estimated  Gaussian  stan¬ 
dard  deviation  at  each  depth  was  scaled 
by  the  step  size  to  determine  the  depth- 
dependent  beam  correlation  width,  or 
<rv(z)-  The  depth  dependency  was  then 
approximated  with  a  polynomial,  result¬ 
ing  in  a  beam  correlation  width  for  the 
given  transducer  and  scarming  settings. 

The  calibration  was  first  verified  on 
other  B-scan  series  in  regions  of  appar¬ 
ently  pure  speckle  in  the  phantom,  with 
use  of  uniform  frame  spacing  from  25.4 
to  279.4  pm.  The  same  pixel  region, 
range  of  ratio  of  mean  intensity  to  SD, 


Figure  1.  Representative  B-scan  breast  image 
demonstrates  the  variety  of  complex  stractures 
present  when  the  position  of  the  scanning 
head  is  calculated.  Accurate  three-dimensional 
spatial  registration  would  be  necessary  to  deter¬ 
mine  the  size  of  the  fibroadenoma  (arrows)  in 
any  selected  plane. 


Figure  2.  Normalized  averaged  autocovariance  function  ui  the 
elevational  direction  for  a  series  of  uniformly  spaced  B  scans  obtained 
in  a  tissue-mimicking  phantom.  The  average  was  computed  over  a  30  x 
10-mm  (300  x  100-pixel)  area,  and  the  frame  separation  was  25.4  pm. 


Figure  3.  Beam  correlation  width  based  on  regional  covariance 
curves  plotted  as  a  function  of  depth,  for  a  13-MHz  linear  anay 
transducer  focused  at  1.5  cm. 
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and  number  of  frames  per  volume  were 
chosen  as  were  used  for  the  calibration. 
The  speckle-selection  and  frame-spacing 
computations  were  then  verified  on  uni¬ 
formly  spaced  scans  obtained  in  a  portion 
of  the  phantom  that  contained  regions 
with  3-mm-diameter  "voids,"  spherical 
regions  of  weak  scatterers. 

The  algorithm  was  also  tested  on  a  scan 
series  with  nonuniform  spacing  obtained 
with  a  freehand  scan  system  (10,11)  that 
allows  the  user  to  slide  a  transducer  along 
a  framework  at  a  variable  rate.  The  trans¬ 
ducer  is  affixed  perpendicular  to  the  scan¬ 
ning  direction  to  prevent  any  lateral, 
range,  or  rotational  movement.  Position 
information  to  within  ±10  pm  is  stored 
by  means  of  an  encoder  connected  to  a 
computer.  Depending  on  the  frame  rate, 
the  transducer  must  be  moved  slowly 
enough  to  ensure  that  consecutive  frames 
are  not  completely  decorrelated. 


Freehand  scans  were  first  obtained  in  the 
phantom  at  "pure"  speckle  regions  and  re¬ 
gions  containing  3-mm-diameter  voids.  Fi¬ 
nally,  clinical  images  were  obtained  in  a 
study  approved  by  our  institutional  review 
board,  with  signed  informed  consent  firom 
the  subjects.  A  series  of  breast  scans  were 
obtained  in  vivo  by  using  the  position- 
encoder  apparatus.  Figure  1  shows  a  repre¬ 
sentative  B-scan  image  obtained  with  the 
same  settings  used  for  the  phantom  scans. 
The  frame  spacings  of  these  fireehand  scans 
were  computed  by  using  the  calibration 
data  and  compared  with  the  spacing  given 
by  using  the  position  encoder. 

I  Results 

The  initial  phantom  scans  were  ob¬ 
tained  with  uniform  spacing  measured 
with  the  micropositioner.  Figure  2  shows 
the  average  frame-to-frame  decorrelation 


Figure  4.  Estimated  spacing  for  a  series  of  uniformly  spaced  scans,  computed  over  10  frames,  with 
(a)  300  X  100-  and  (b)  300  X  10-pixel  regions.  Enor  bars  indicate  ±  1 SD  of  average  estimation. 


in  a  pure  speckle  region,  with  25.4-pm 
spacing,  and  the  Gaussian  fit. 

For  the  calibration,  a  300  x  100-pixel 
region  (corresponding  to  3  x  l-cm^  area) 
was  chosen.  The  resultant  depth-depen¬ 
dent  beam  correlation  width  of  the  trans¬ 
ducer  is  shown  in  Figure  3.  Even  in  re¬ 
gions  of  apparently  "pure"  speckle,  the 
distribution  of  the  ratio  of  mean  intensity 
to  SD  around  its  average  value  of  1.0 
broadens  as  a  result  of  statistical  fluctua¬ 
tions  when  the  area  in  which  it  is  calcu¬ 
lated  decreases.  With  a  range  of  ratio  of 
mean  intensity  to  SD  of  0.9-1. 1  and  a 
window  size  of  21  x  21  pixels,  the  area 
marked  as  speckle  with  the  speckle  selec¬ 
tor  was  roughly  40%  of  the  total  region. 
This  low  acceptance  rate  is  a  trade-off 
between  the  high  spatial  resolution  of  the 
mask  and  the  rigorous  rejection  of  non¬ 
speckle  regions. 

To  test  the  scaling  of  the  calibration  set 
to  other  frame  spacings  and  to  find  the 
maximum  image  spacing  to  which  accu¬ 
rate  separation  calculations  are  possible, 
the  algorithm  was  applied  to  subsets  of  a 
scan  with  25.4-pm  frame  spacing.  A  sub¬ 
sample  of  the  frames  was  obtained  to 
create  sets  with  spacings  from  25.4  to 
279.4  pm.  The  result,  based  on  a  300  x 
100-pixel  region  (Fig  4a),  shows  excellent 
agreement  between  calculated  and  nomi¬ 
nal  spacings,  with  less  than  3%  error  up 
to  125  pm.  For  larger  spacings  that  ap¬ 
proach  the  correlation  half  width  of  the 
beam,  the  error  increased  steadily  to 
-4.9%  at  225  pm  and  -6.1%  at  279.4 
pm.  For  smaller  regions,  the  SD  of  the 
estimated  spacing  increased  due  to  the 
reduced  number  of  pixels.  Above  200  pm, 
the  speckle  Images  are  fully  decorrelated 
after  only  two  to  three  frames,  which 


a.  b. 

Figure  5.  (a)  B  scan  was  obtained  in  a  tissue-mimicking  phantom  that  contained  3-mm-diameter  voids,  (b)  Corresponding  binary  speckle-detector 
mask  was  determined  on  the  basis  of  the  ratio  of  mean  intensity  to  SD  for  a  moving  volume  (21  x  21  pixels  x  10  frames).  The  white  regions  denote 
areas  where  the  ratio  of  mean  intensity  to  SD  decreased  to  between  0.8  and  1.2. 
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increases  the  error  considerably  in  the 
Gaussian  fit.  However,  the  average  spac¬ 
ing  was  reproduced  well  up  to  225  pm  for 
a  300  X  10-pixel  region  in  the  center  of 
the  focal  zone  (Fig  4b).  The  improvement 
in  the  mean  estimate  of  the  section  spac¬ 
ing  results  from  the  exclusion  of  pixels 
outside  the  elevational  focal  zone,  which 
in  this  case  was  only  approximately  30 
pixels  deep.  The  theory  (Appendix)  as¬ 
sumes  the  pixels  are  being  taken  from  the 
focal  zones  so  some  systematic  error  might 
be  anticipated  if  pixels  from  outside  this 
region  are  included.  This  argues  strongly 
for  the  use  of  multiple  elevational  elec¬ 
tronic  focusing. 

The  efficacy  of  the  speckle  detector  was 
demonstrated  in  regions  of  the  phantom 
that  contain  speckle  and  voids  (Fig  5a). 
The  boundaries  between  the  small,  weakly 
scattering  voids  and  the  background  con¬ 
stitute  structure  that  cannot  be  used  for 
the  section  spacing  computation.  With 
use  of  a  range  for  ratio  of  mean  intensity 
to  SD  of  0.8-1. 2,  the  selector  successfully 
masked  out  the  voids,  leaving  the  "pure" 
speckle  regions  for  calculation  (Fig  5b). 

For  the  freehand  scanning  experiments, 
the  frame  rate  was  set  to  the  video  rate  of 
30  Hz.  Assuming  the  largest  discernible 
frame  separation  is  250  pm,  the  maxi¬ 
mum  allowable  transducer  speed  for  this 
frame  rate  was  7.5  mm/sec.  Scan  sets  of 
the  phantom  were  recorded  as  the  sonog- 
rapher  attempted  to  move  the  transducer 
at  either  uniform  or  variable  speeds.  Fig¬ 
ure  6a  displays  the  estimated  and  actual 
frame  spacing  in  roughly  uniform  scan¬ 
ning,  and  Figure  6b  shows  the  results  in  a 
scan  set  for  which  the  sonographer  in¬ 
creased  the  transducer  speed  midway 
through  scanning,  over  a  region  of  ho¬ 
mogenous  speckle.  The  speckle-decorrela¬ 
tion  estimator  tracked  the  actual  position 
well,  with  a  mean  error  of  7%  root-mean- 
square  for  the  frame  spacing  and  of  3% 
root-mean-square  for  the  total  distance 
traveled.  Scanning  sweeps  performed  over 
the  void-filled  portion  of  the  phantom 
showed  similar  results  (Fig  6c,  6d).  The 
total  distance  traveled  in  the  two-speed 
scan  in  Figure  6c  is  shown  in  Figure  7a,  as 
is  the  corresponding  percentage  of  actual 
pixels  used  (Fig  7b)  as  determined  with 
the  adaptive  mask  for  ratio  of  mean  inten¬ 
sity  to  SD.  The  square  of  the  correlation, 
R^,  defined  as  1  minus  the  ratio  of  the 
variation  of  the  residuals  over  the  varia¬ 
tion  in  position,  demonstrates  the  accu¬ 
racy  of  the  estimate. 

In  the  clinical  study,  one  image  series 
was  obtained  from  a  set  of  breast  scans 
that  depicted  a  fibroadenoma  (Fig  1).  The 
same  transducer  and  scanner  settings  were 


if 


Figure  6.  Graphs  demonstrate  comparison  of  decorrelation-estimated  image  separation  with 
spacing  computed  from  position-encoder  information  for  freehand  scan  sets,  (a)  Scans  obtained 
with  approximately  imiform  speed  over  the  speckle  region  in  the  phantom,  (b)  Scans  obtained 
with  two  speeds  over  the  same  region  as  in  a.  (c)  Scans  obtained  with  approximately  uniform 
speed  over  the  void  region  in  the  phantom,  (d)  Scans  obtained  with  two  speeds  over  the  same 
region  as  in  c.  In  a-d.  Cor.  Estimation  =  correlation  estimation. 


used  as  were  used  for  the  phantom  scans. 
Given  only  one  focus,  the  B-scan  image  is 
not  ideal  and  the  tumor  outline  is  unclear. 
However,  the  speckle  correlation  estimate 
for  the  frame  spacing  tracked  the  position 
data  with  an  accuracy  of  87%  (Fig  8).  The 
region  within  and  surrounding  the  tumor 
deviated  from  true  speckle,  and  the  num¬ 
ber  of  pixels  used  in  the  mask  for  ratio  of 
mean  intensity  to  SD  decreased  to  1,350.  A 
transverse  scan  (with  the  axial  and  eleva¬ 
tional  resolution)  through  the  tumor  was 
reconstructed  by  using  the  position  infor¬ 
mation  (Fig  9a).  The  resolution  of  this 
out-of-plane  scan  is  comparable  to  that  of 
the  original  B  scan.  Finally,  Figure  9b  shows 
a  reconstructed  C-scan  section  (with  the 
lateral  and  elevational  resolution)  ob¬ 
tained  midway  through  the  lesion. 

In  another  clinical  patient,  the  sonogra¬ 
pher  obtained  a  breast  scan  while  varying 
the  scanning  speed.  A  transverse  image 


was  then  reconstructed  with  the  assump¬ 
tion  of  a  uniform  scanning  speed  (Fig 
10a).  The  arrow  denotes  the  area  where 
the  sonographer  slowed  down,  and  the 
actual  frame  spacing  is  decreased.  Figure 
10b  shows  the  reconstruction  obtained 
with  the  estimated  frame  spacing  and 
interpolation.  Incorporation  of  the  spac¬ 
ing  information  subjectively  reduced  blur¬ 
ring  and  increased  image  quality,  with 
better  definition  of  cormective  tissue  struc¬ 
tures.  For  this  scan,  the  maximum  position 
error  was  1.49  mm  (mean  error,  13.9%). 

As  a  final  test,  a  freehand  scan  that 
allowed  tilting  was  obtained  in  the  phan¬ 
tom.  The  transducer  was  swept  smoothly 
through  30°  with  the  transducer-phan¬ 
tom  interface  as  the  axis  of  rotation.  The 
estimated  row  spacing  was  averaged  over 
250  frames.  Whereas  exact  positioning 
could  not  be  recorded,  the  estimated  frame 
spacing  inaeased  linearly  with  depth  (Fig 
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Figure  7.  (a)  Estimated  values  for  the  total  distance  traveled  by  the  transducer,  corresponding  to  the  accumulation  of  the  frame  spacings  shown  in 
Figure  6c.  Cor.  Estimation  =  correlation  estimation,  (b)  Corresponding  percentage  of  pixels  masked  by  the  speckle  selector  and  used  in  the  section 
spacing  estimation. 


Figure  8.  (a)  Estimated  frame  spacing  for  breast  images  obtained  in  a  freehand  scanning  study,  (b)  Corresponding  total  lateral  distance  scanned  by 
the  transducer.  In  a  and  b,  Cor.  Estimation  =  correlation  estimation. 


11),  indicating  the  feasibility  of  tracking 
transducer  tilt  and  possibly  other  motions 
in  addition  to  linear  translations. 

I  Discussion 

The  elevational  decorrelation  curves 
matched  well  with  the  Gaussian  function 
as  predicted  by  the  theory.  It  should  be 
noted  that  the  error  in  the  autocovari¬ 
ance  estimate  increased  with  lag  number 
or  the  total  distance  between  frames.  As 
the  decorrelation  curve  decreased,  the 
estimate  became  unreliable,  and  thus  only 


point  values  greater  than  0.3  were  used  in 
the  Gaussian  curve  fit.  For  large  frame 
spacings,  the  speckle  decorrelated  in  just 
a  few  frames,  which  reduced  the  number 
of  points  used  in  the  curve  fit  and  thus 
increased  the  error  for  the  section  spacing 
approximation. 

The  beam  correlation  width  for  the 
focused  transducer  showed  interesting  re¬ 
sults  as  a  function  of  depth.  The  curve 
peaked  just  above  the  focal  region.  Close 
to  the  transducer,  a  fast  decorrelation  was 
expected  due  to  the  incoherent  nature  of 


the  beam  in  the  near  zone.  At  large  depths, 
a  fast  decorrelation  rate  was  also  expected 
due  to  the  dominance  of  noise  in  the  signal 
and  the  incoherence  of  the  beam. 

For  linear  scans,  the  speckle-decorrela¬ 
tion  technique  showed  excellent  results 
in  estimating  frame  separation  and  track¬ 
ing  the  overall  distance  traveled.  As  long 
as  the  sonographer  did  not  exceed  motion 
of  200  pm  per  frame  and  sufficient  areas  of 
speckle  were  present  in  the  scans,  the  firame 
spacing  was  accurately  estimated. 

The  increased  error  in  the  clinical  scans 
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a.  b. 


Figure  9.  (a)  Transverse  image  of  a  breast  fibroadenoma  (F)  formed  by  selecting  a  vertical  section 
through  a  set  of  B-scan  images  and  correcting  for  transducer  position,  (b)  C-scan  image  obtained 
from  the  same  B-scan  set. 


a.  b. 


Figure  10.  Reconstruction  images  of  a  transverse  image  that  was  obtained  from  a  set  of  breast 
scans,  (a)  Reconstmction  image  with  uniform  spacing  between  frames.  Arrow  indicates  a  region 
where  the  sonographer  slowed  down  during  scanning,  (b)  Reconstruction  image  with  variable 
frame  spacing  determined  with  the  speckle-decorrelation  algorithm. 


was  expected.  When  the  translator  frame¬ 
work  was  placed  on  the  breast,  pressure 
was  applied  to  maintain  good  contact 
between  the  skin  and  transducer.  As  the 
transducer  was  moved  along  the  surface, 
there  was  a  slight  repositioning  of  the 
underlying  tissue,  which  was  undetected 
by  the  position  encoder.  Also,  breast  con¬ 
tains  large  amounts  of  phase-aberrating 
tissue  that  would  degrade  the  beam¬ 
forming  process  and  increase  the  beam 
correlation  width  of  the  transducer.  The 
result  is  a  bias  in  the  estimated  frame 
separation  below  its  actual  value.  How¬ 
ever,  it  should  also  be  noted  that  the 
"actual"  separation  based  on  the  encod¬ 
ing  system  may  also  not  be  correct  due  to 
relative  motion  between  the  frame  and 
the  tissue.  This  motion  would  actually  be 
accounted  for  by  the  image-based  registra¬ 
tion  technique,  and  as  such,  the  result 
may  actually  be  more  accurate  than  the 
"actual"  result  used  for  comparison.  In 
the  same  sense,  the  image-based  registra¬ 
tion  technique  would  give  more  accurate 
spatial  measurement  in  tissues  moving 
rapidly  (eg,  with  respiration)  than  would 
measurements  based  on  an  external  frame 
of  reference.  This  would  be  particularly 
helpful  in  compounding  of  pulsed  Dopp¬ 
ler  images  (12). 

The  current  setup  has  some  limitations 
critical  to  its  use  in  a  clinical  setting.  The 
scanning  speeds  for  this  study  were  quite 
slow  (maximum  velocity,  7.5  mm/sec  at 
30  Hz).  Use  of  higher  frame  rates  would 
alleviate  this  problem,  though  there  is  a 
trade-off  with  reduced  number  of  focal 
zones  and  smaller  field  of  view.  In  theory, 
only  limited  amounts  of  information, 
obtainable  in  real  time,  would  be  re¬ 
quired,  and  thus  limitations  of  scanning 
speed  would  be  reduced. 

As  previously  noted  (7),  this  technique 
could  be  implemented  in  real  time  since 
only  a  portion  of  the  image  is  needed 
to  determine  transducer  motion.  Similar 
to  or  in  conjunction  with  power  Doppler 
estimations,  a  few  pulses  at  high  pulse 
repetition  frequency  could  be  transmit¬ 
ted  between  acquisition  of  data  from  two 
consecutive  images.  The  conelations  could 
be  computed  at  high  speeds  with  a  pro¬ 
grammable  image  processor  board  as  is 
used  with  other  US  imaging  technology 
(13,14). 

For  the  clinical  study,  the  transducer 
was  limited  to  translational  movement. 
The  framework,  which  also  permits  rota¬ 
tion  around  a  fixed  axis,  was  designed  for 
scanning  of  large  body  parts  such  as 
breast,  liver,  or  Achilles  tendon.  These 
two  encoded  motions  were  chosen  as  the 
most  useful  in  circumstances  such  as  scan¬ 


ning  up  to  and  under  the  ribs.  Our  future 
work  will  emphasize  regional  speckle 
analysis  to  calculate  motion  and  thus 
allow  rotation  of  the  transducer.  A  prelimi¬ 
nary  frame-to-frame  correlation  can  also 
be  used  to  account  for  lateral  and  axial 
motion.  This  would  permit  scanning  with 
a  freely  held  transducer  without  use  of 
any  position  framework. 

The  speckle-decorrelation  algorithm 
provides  image-based  registration  of  US 
frame  sections  obtained  with  a  freely 
moving  handheld  transducer.  Findings  in 
this  study  have  shown  that  for  three- 
dimensional  B-scan  sets,  the  section  spac¬ 
ing  can  be  determined  effectively  on  the 
basis  of  the  speckle  decorrelation  from 
frame  to  frame.  By  moving  a  transducer 
slowly  over  the  region  of  interest  and 
restricting  additional  degrees  of  freedom, 


the  frame  spacing  is  calculated  without 
use  of  any  additional  position-encoding 
hardware.  While  the  errors  for  the  abso¬ 
lute  frame  distance  vary  near  10%,  the 
accumulative  error,  which  is  critical  for 
tumor  or  other  volume  estimation,  is 
much  smaller.  The  efficacy  of  the  tech¬ 
nique  was  further  demonstrated  (or  sug¬ 
gested)  in  clinical  breast  scans,  and  addi¬ 
tional  work  should  enhance  image-based 
reconstruction  of  three-dimensional  im¬ 
ages. 

I  Appendix 

Speckle  is  formed  by  the  coherent  scat¬ 
tering  from  subresolvable  particles.  The 
derivation  for  this  algorithm  starts  with  a 
stochastic  analysis  of  the  received  ampli¬ 
tude  signal  (15,16).  If  the  number  of 
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Figure  11.  Estimated  depth- varying  frame  spacing  for  phantom 
scan  series  obtained  by  hand  tilting  a  transducer  through  an  approxi¬ 
mately  30°  arc,  with  the  face  of  the  scanning  head  as  the  axis  of 
rotation.  The  spacing  at  each  depth  was  averaged  over  250  frames.  Cor. 
Estimation  =  conelation  estimation. 


independent  scatterers  in  the  scanning 
volume  is  large,  then  on  the  basis  of  the 
central  limit  theorem,  the  sum  of  the 
complex  signals  will  have  a  Gaussian 
distribution  with  mean  of  zero  and  vari¬ 
ance  of  a^.  With  use  of  a  transformation 
of  variables,  the  amplitude.  A,  is  shown  to 
have  a  Rayleigh  distribution,  p, 

PpiA)  =  Ata^  exp  {-A^I2<s^. 

Analysis  of  the  first-order  statistics  pro¬ 
vides  an  interesting  result:  The  ratio  of 
the  mean  intensity  to  SD  is  a  constant 
1.91. 

For  this  analysis,  the  statistics  for  the 
intensity  (i)  or  squared  amplitude  are 
required.  By  again  applying  a  variable 
transformation,  the  intensity  is  shown  to 
have  a  negative  exponential  distribution, 

p,(l)  =  1/20-2  exp  (-//2(t2), 

which  has  a  mean  of  2a^  and  a  variance  of 
4ct^.  Thus  for  fully  developed  speckle,  the 
intensity  image  should  have  a  constant 
ratio  of  mean  intensity  to  SD  of  1.0. 

Second-Order  Statistics 

To  relate  the  fluctuations  in  image  in¬ 
tensity  from  frame  to  frame,  the  second- 
order  statistics  of  the  speckle  are  used 
(17).  The  amplitude  autocorrelation  (Rj^) 
for  positions  Ti  and  is  defined  as 

RAiTi,  rz)  =  (Mrx)A{r2)), 
and  the  autocovariance  (Q)  is 

CA(ri,  T2)  =  Ra{ti,  T2)  —  {A(ri)){A*(r2)), 


where  ( )  denotes  the  expected  value.  The 
normalized  autocovariance,  p,  is  referred 
to  as  the  correlation  function. 

The  amplitude  signal  is  formed  from 
the  convolution  of  the  transducer  point- 
spread  function  with  the  insonified  scat¬ 
tering  train.  The  autocorrelation  function 
of  the  amplitude  is  the  convolution  of  the 
autocorrelation  functions  for  the  point- 
spread  function  and  the  scatterers.  For  pure 
speckle,  the  scatters  are  independent  and 
the  autocorrelation  can  be  approximated  as 
a  8  function.  Consequently,  the  amplitude 
autocorrelation  is  directly  proportional  to 
the  point-spread-function  autocorrelation. 

For  a  focused  transducer,  the  point- 
spread  function  near  the  focal  zone  is 
proportional  to  the  square  of  the  Fourier 
transform  of  the  transducer  aperture  (18). 
With  the  rectangular  linear  array,  focus¬ 
ing  of  the  electronic  beam  apodizes  side 
lobes.  The  beam  pattern  can  then  be 
approximated  with  a  Gaussian  curve, 
and  the  point-spread-function  autocorre¬ 
lation  will  also  be  Gaussian  (19), 

P(''u  rz)  =  exp  [-(ri  - 

where  is  related  to  the  beam  width. 

After  a  similar  derivation  (17),  the  in¬ 
tensity  autocorrelation  is  shown  to  have 
the  form 

RiiTx,  rz)  =  (/(ri)/(rz)) 

=  (foP  [1  -b  lp(ri,  rz)|2] 
and  the  autocovarianc?  is 

Ciiri,  rz)  =  if  of  |p(ri,  rz)P, 


where  </o>  is  the  average  image  inten¬ 
sity.  The  intensity  correlation  function  is 
thus  directly  related  to  the  amplitude 
correlation  function. 

This  one-dimensional  analysis  can  also 
be  expanded  to  include  temporal  correla¬ 
tion  properties  for  relative  motion  be¬ 
tween  the  transducer  and  the  insonified 
tissue  (20).  For  a  transducer  velocity  of 
(in  distance  per  frame)  and  B-scan  frame 
number  n,  the  normalized  intensity  eleva- 
tional  covariance  for  a  single  pixel  loca¬ 
tion  then  has  a  Gaussian  shape  (19), 

C(n,  z)  K  exp  [-(V;<«)2/2ctP(z)], 

where  ay(z)  is  the  depth-dependent  beam 
correlation  width  and  is  determined  by 
the  transducer  properties.  By  fitting  the 
correlation  function  for  a  set  of  N  frames 
to  a  Gaussian  curve,  the  average  frame 
spacing  for  that  set  can  be  back  calcu¬ 
lated. 
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Abstract 

Several  potential  uses  of  image  registration  and  new  display  techniques  in  3-dhnensional  ultrasound  imaging  are  demonstrated 
in  three  examples,  representing  several  types  of  applications:  First,  tiie  gray-scale  information  of  a  color-flow  image  set  was 
coregistered  with  a  high  resolution  gray-scale  set  covering  the  same  region  of  interest.  The  high  accuracy  achieved  in  this 
registration  suggests  that  this  technique  can  create  improved  images  from  combined  ultrasound  modes.  Second,  several  parallel, 
p^y  overlapping  gray-scale  scans  of  a  female  breast  with  several  lesions  were  coregistered  and  combined  into  one  larger  voliune. 
Only  in  this  extended  field  of  view  could  the  lesions  be  viewed  simultaneously  and  their  relative  sizes  and  positions  be 
appreciated,  suggesting  the  potential  of  better  detection  of  changes  in  breast  regions  being  followed  for  potential  cancer.  Third,  the 
image  registration  was  applied  to  a  series  of  ultrasound  breast  exams  for  cancer  therapy  assessment.  In  spite  of  considerable  tumor 
shrinkage  between  the  two  scans  obtained  several  weeks  apart,  the  coregistration  mapped  the  dominant  features  in  the  region  of 
interest  and  thus  facilitated  tracking  of  changes  over  time,  both  with  direct  comparison  and  with  displays  that  highlighted  changes. 
The  quality  of  the  semiautomatic  coregistrations  achieved  and  the  significance  of  the  applications  demonstrated  here  indicate  that 
image  registration  may  become  a  valuable  tool  in  improving  ultrasound  diagnostics. 
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Introduction 

Image  registration  or  coregistration,  the  alignment  of  two  or  more  2-dimensional  (2-D)  or  3-dimensional  (3-D)  images  of  an 
object,  has  b^n  applied  to  m^cal  imaging  for  more  than  ten  years.  One  major  application  of  medical  image  registration  is  fusion 
of  morphological  images  such  as  magnetic  resonance  imaging  (MRI)  and  X-ray  computed  tomography  (CT)  with  functional 
studies  such  as  positron  emission  tomography  (PET)  and  single  photon  emission  computed  tomography  (SPECT)  (1-7).  Other 
applications  of  coregistrations  include  motion  detection  (8,  9),  subtim:tion  imaging  (10,  IIX  and  treatment  planning  (12,  13).  A 
comprehensive  review  of  different  approaches  and  techniques  in  medical  image  matching  can  be  found  in  (14). 

Until  recently,  ultrasound  image  registration  has  not  been  successful,  partly  because  of  the  small  2-D  field  of  view  and  possibly 
strong  tissue  motion  and  deformation  which  make  it  difficult  to  obtain  consistent  image  pairs  for  coregistration  using  convention^ 
manual  scaiming. 

With  the  advent  of  3-D  sonography  in  research  (15,  16)  and,  more  recently,  in  commercially  available  ultrasound  scanners, 
volumetric  ultrasound  data  have  become  available  and  can,  in  principle,  be  registered  like  3-D  data  sets  fiom  other  imaging 
modalities.  However,  the  speckle  noise  and  image  artifacts  usually  present  in  ultrasound  images  and  the  strong  an^ar 
dependency  of  the  apparent  brightness  of  specular  reflectors  challenge  the  robustness  of  registration  algorithms. 

Apparently  the  fimt  successM  coregistration  of  3-D  ultrasound  scans  in  a  phantom  and  in  the  breast  was  reported  in  (17),  using 
registration  software  that  required  user  definition  of  homologous  points,  lines,  and  planes  in  the  data  sets.  Semiautomatic 
coregistrations  of  ultrasound  scans  were  achieved  very  recently  (18,  19)  using  software  based  on  the  mutual  information  (MI)  of 
two  data  sets.  The  same  software  was  used  in  this  study  to  demonstrate  three  examples  of  potential  applications  of  coregistration  in 
ultrasound  breast  imaging.  The  display  possibilities  in  this  electronic  medium,  especially  the  movie  features,  should  allow  better 
visualization  of  registration  quality  and  assessment  of  errors  than  conventional  journals. 

The  gray-scale  image  obtained  along  with  the  color  information  in  Doppler  modes  usually  suffers  from  poor  spatial  resolution 
compared  to  the  high  resolution  obtainable  in  the  gray-scale-only  mode.  After  registration  of  a  3-D  Doppler  mode  data  set  with  a 
gray-scale  set,  the  color  information  can  be  superimposed  on  a  high  resolution  gray-scale  background,  thus  extracting  the  best  of 
both  imaging  modes.  Potentially,  this  allows  more  accurate  diagnosis  and  higher  sensitivity  in  lesion  detection  by  displaying  flow 
information  in  place  with  a  high  quality  gray-scale  image. 

The  small  field  of  view  (FOV)  usually  covered  by  a  high  resolution  scanhead  may  be  insufficient  to  use  the  full  capabilities  of 
3-D  ultrasound  to  detect  and  track  changes  in  breast  regions  being  screened  or  followed  for  possible  lesions  or  response  to 
treatment.  Often  the  FOV  is  also  too  small  to  use  the  fixll  advantages  of  3-D  in  displaying  morphologic  distortions  of  normal  tissue 
and  flow  surrounding  the  mass  and  differences  between  the  possible  mass  and  a  statistic^y  robust  sampling  of  surrounding 
tissues.  To  create  a  complete  or  more  complete  image  of  the  breast,  the  small  volume  covered  by  a  single  scan  can  be  extended  by 
repeatedly  scanning  the  breast  in  parallel,  partially  overlapping  sweeps  which  can  then  be  combined  using  coregistration  of  the 
overlap.  Compared  to  a  commerci^y  available  2-dimensional  extended  filed  of  view  approach  (20, 21),  our  method  allows  much 
faster  acquisition  of  3-dimensional  volumes  and  is  applicable  as  a  post-processing  scheme  aftw  the  individual  scans  have  been 
obtained. 

In  ultrasound  screenings  of  the  breast,  some  malignant  changes  are  manifest  as  changes  in  echogenicity,  texture,  and 
morphology.  Early  detection  of  these  changes  can  improve  survival  rates  (22).  Changes  in  a  structure's  size  or  shape  can  also  aid 
detection  of  a  malignancy  or  give  important  feedback  in  serial  ultrasound  exams  for  the  assessment  of  response  to  cancer  therapy. 
Coregistration  of  3-D  ultrasound  exams  can  facilitate  the  temporal  tracking  of  changes  by  coregistering  the  suspect  regions  of 
interest  imaged  at  different  times,  thus  allowing  direct  comparison  of  the  'before'  and  '^er'  texture  and  morphology. 
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Materials  and  Methods 

A  LOGIQ  700  ultrasound  scanner  (GE  Medical  Systems,  Milwaukee,  WI)  with  a  12  MHz  1.5-dunensional  matrix  linear 
array  probe  was  used  to  obtain  3-D  data  sets  of  the  breast.  The  probe  was  mounted  in  a  holder  that  restricted  it  to  a  linear  motion 
in  the  elevational  direction  (perpendicular  to  the  image  plane)  while  electronically  encoding  the  position  of  the  probe.  A  more 
detailed  description  of  the  data  acquisition  scheme  can  be  found  in  (23). 

The  holder  was  placed  on  the  breast  and  the  transducer  slowly  moved  by  hand  over  the  region  of  interest.  The  high  resolution 
gray-scale  (GS),  frequency-shift  (f-CDI),  and  power-mode  color  Doppler  (p-CDI)  images  obtained  were  then  interpolated  and 
resampled  with  a  uniform  elevational  spacing  of  approximately  0.4  mm  using  the  position  data  stored  along  with  the  images. 
Display  and  registration  of  the  data  sets  were  performed  using  AVS/5  and  AVS/Express  (Advanced  Visual  Systems,  Waltham, 
MA). 

The  3D  image  registration  software  MIAMI  Fuse  was  originally  developed  for  fusion  of  data  sets  from  multiple  imaging 
modalities  incluthng  various  combinations  of  MRI,  CT,  PET,  and  SPECT. 

To  define  the  approximate  relative  position  of  the  two  data  sets  to  be  coregistered,  three  control  points  have  to  be  defined  in 
each  set  This  is  usually  done  by  assuming  the  images  were  obtained  in  the  same  location  and  in  the  same  orientation  and  requires 
very  limited  user  interaction.  The  algorithm  then  repeatedly  performs  geometrical  transformations,  rigid  or  fuU  affine,  on  one  of  two 
sets  and  maps  it  onto  the  second  set  until  the  best  fit  between  the  two  sets  is  found.  Here,  the  mutual  information  (24,  25)  of  the 
data  sets  is  used  as  a  cost  function  to  determine  the  quality  of  a  fit  With  more  control  points,  warping  transformations  can  be 
performed,  but  that  was  not  done  in  this  study.  For  a  more  detailed  description  of  the  algorithm  and  evaluation  of  its  performance 
with  PET/CT,  PET/MRI  and  SPECT/CT  multimodal  data  sets  see  (26).  More  details  on  the  application  of  this  image  registration 
software  to  3-D  ultrasound  data  sets  are  given  in  (19). 

The  registration  software  was  used  here  to  demonstrate  registration  of  3-D  ultrasound  scans  of  the  breast  for  three  different 
applications.  For  each  class  of  application,  one  typical  case  is  displayed  to  demonstrate  its  potential  value  in  ultrasound 
diagnostics. 

All  patient  data  were  acquired  after  informed  consent  was  obtained. 

1.  The  first  application  is  the  fusion  of  color  information  from  Doppler  imaging  modalities  with  gray  scale  information  from  a 
high  resolution  gray-scale  scan  of  the  same  volume.  For  this  purpose,  the  right  breast  of  a  forty  year  old  female  patient  was 
scanned  in  f-CDI  mode  and,  several  minutes  later,  in  high  resolution  gray-scale  mode,  using  average  elevational  frame  spacings  of 
0.43  mm  and  0.47  mm,  respectively.  The  gray-scde  information  of  the  two  scans  was  then  coregistered  and  displayed  in  various 
ways  to  evaluate  the  goodness  of  match. 

2.  Extended  3-D  field  of  view  imaging  is  the  second  application  demonstrated  in  this  study.  Three  parallel,  high  resolution  gray 
scale  scans  were  obtained  in  the  left  breast  of  a  65  year  old  woman  diagnosed  with  a  60  mm  invasive  ductd  carcinoma.  The 
relative  position  and  alignment  of  the  scans  is  shown  schematically  in  Figure  1.  Starting  with  a  scan  in  the  center  of  the  region  of 
interest  (B,  average  elevational  finme  spacing  0.32  mm),  the  4  cm  wide  aperture  of  the  transducer  was  then  shifted  1  to  3  cm 
medially  (A,  frame  spacing  0.29  mm)  and  laterally  (C,  frame  spacing  0.37  mm),  respectively,  before  the  second  and  third  scans. 
Thus,  3-D  data  sets  with  25%  to  75%  overlap  (AB,  BC)  were  obtained.  Volume  registration  was  then  performed  on  the 
overlapping  regions  to  find  the  necessary  transformations  and  exact  relative  positions  of  the  data  sets,  mapping  scan  A  and  C  into 
the  reference  frame  given  by  scan  B. 
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Figure  1.  The  diagram  shows  the  relative  positions  of  three 
individual  scans  A,  B,  and  C,  combined  into  one  extended  3-D  field 
of  view.  The  three  scans  are  approximately  parallel  and  overlap  at 
least  25%  to  achieve  sufficient  accuracy  in  the  coregistration.  Scan 
B  serves  as  a  reference,  the  overlap  AB  is  used  to  align  scan  A 
relative  to  B,  and  similarly  BC  is  used  to  align  C  relative  to  B. 

3.  The  third  application  presented  in  this  article  is  the  registration  of  ultrasound  scans  obtained  several  weeks  apart  in  the 
course  of  a  serial  study.  For  this  application,  the  same  subject  was  scanned  as  for  the  extended  field  of  view  imaging.  The  central 
lesion  in  the  left  breast  of  the  woman  was  scanned  four  times,  8  days  before  and  29, 55,  and  78  days  after  the  first  of  four  cycles  of 
CAF  (Cytoxin,  Adriamycin,  Flourouracil)  chemotherapy.  The  second  scan  served  as  a  reference  relative  to  which  the  first,  fliird 
and  fourth  scan  were  coregistered.  Although  visual  inspection  of  the  scans  showed  significant  changes  of  the  lesion,  the 
coregistrations  were  performed  without  prior  cropping  or  otherwise  pre-processing  the  image  sets.  While  this  inherently  increases 
the  inaccuracy  of  the  coregistration,  it  does  serve  to  demonstrate  the  feasibility  of  using  ultrasound  image  registration  for 
evaluation  of  serial  studies  without  significant  user  interaction. 

In  each  application,  the  quality  of  the  coregistration  was  evaluated  by  displaying  the  registered  image  sets  side  by  side  and 
manually  defi^g  pairs  of  corresponding  feature  landmarks  in  the  two  sets.  The  mean  of  the  distances  between  point  pairs 
defining  common  landmarks  was  then  used  as  an  estimate  of  the  alignment  errors  after  registration. 
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Results 

1.  Multimodal  Ultrasound  Im^jng 

Figures  2  and  3  show  the  results  of  registering  a  3-D  f-CDI  volume  with  a  high  resolution  gray-scale  volume.  The  two  image 
volumes  were  acquired  sequentially  during  a  single  patient  visit  The  forty  year  old  female  patient  was  diagnosed  wifli  right 
infiltrative  ductal  carcinoma.  Note  the  13  mm  spiculated  mass  which  appears  in  both  Figures  2(b)  and  3  (white  arrow). 


(a)  (b)  (c) 

Figure  2 .  Composite  representation  of  an  f-CDI  volume  coregistered  with  a  high  resolution  gray-scale 
volume.  The  high  resolution  gray-scale  images  are  pseudo-colorized  and  superimposed  onto  the  gray-scale 
of  the  f-CDI  set.  The  scans  were  performed  minutes  apart,  (a)  Three  orthogonal  planes  of  the  3-D 
coregistered  volume.  The  white  labels  indicate  our  naming  scheme  for  the  three  planes,  (b)  Axial-lateral  (z) 
scan  plane.  The  white  arrow  points  at  the  13  mm  spiculated  mass,  (c)  Axial-elevational  (x)  transverse  plane. 
Click  each  image  to  view  its  full  sized  counterpart.  Click  here  for  a  Quicktime  movie  (444  kB)  scanning 
through  the  entire  volume  and  containing  the  frames  shown  in  (a)-(c).  For  a  high-quality  version  of  the 
same  movie  (1.2  MB),  click  here. 


In  Figure  2,  the  volumetric  data  is  shown  as  composite  images  of  the  f-CDI  and  the  high  resolution  gray-scale  scans.  Figure 
(a)  displays  three  orthogonal  planes  of  the  3-D  volume,  (b)  and  (c)  display  the  axi^-lateral  and  axial-elevational  planes, 
respectively.  The  gray-scale  component  of  the  f-CDI  is  represented  with  a  "gray-scale"  map,  while  the  high  resolution  gray-scale 
is  colorized  by  the  blue  to  red  spectrum,  representing  dark  to  light  echo  regions.  The  two  image  sets  are  Qien  superimposed  onto 
each  other.  Note  the  overlap  of  features  in  ^  three  images  of  the  figure,  witii  reds  and  yellows  overlapping  the  lighter  features.  To 
view  a  (Quicktime  movie  (444  kB)  scaiming  through  the  entire  volume,  click  here  or  follow  the  link  in  Ae  figure  caption. 

In  Figure  3,  the  particular  scan  plane  shown  in  Figure  2(b)  is  presented  in  a  different  way.  In  this  case,  the  coregistered  planes 
are  not  combined  into  a  composite  view.  Rather,  a  diagonal  line  separates  the  gray-scale  firom  the  f-CDI  (upper  left)  from  the  high 
resolution  gray-scale  image  (lower  right).  The  viewer  is  then  able  to  see  the  aligmnent  of  various  features  at  the  diagonal  bound^ 
for  comparison.  Note  that  the  sharp  borders  of  the  spiculated  mass  (white  arrow)  clearly  visible  in  Figure  3(b)  are  barely 
discernible  in  the  gray-scale  from  the  f-CDI  image  shown  in  Figure  3(a).  In  a  Quicktime  "wiper"  movie  (348  kB),  the  viewer  can 
appreciate  both  the  accuracy  of  the  registration  as  well  as  the  sharpness  of  the  high  resolution  gray-scale  over  feat  of  fee  f-CDI 
view  by  sweeping  fee  border  back  and  forth  over  fee  suspicious  region.  Again,  click  here  for  fee  movie  or  follow  fee  link  in  fee 
caption. 
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(a)  (b) 

Figure  3.  Lateral-axial  scan  plane  shown  in  Figure  2(b).  In  both 
images,  the  left  of  the  diagonal  line  shows  the  gray-scale  from  the  f-CDI 
while  the  lower  right  shows  the  high  resolution  multifocal  gray-scale 
image,  (a)  More  of  the  lower  resolution  image  is  shown.  Note  the 
alignment  of  various  structures  at  the  diagonal  image  boundary,  (b)  In 
this  view,  more  of  the  high  resolution  gray-scale  is  shown.  Note  the 
detectability  of  the  spiculated  mass  (white  arrow)  just  to  the  right  of  the 
diagonal  line  in  the  upper  portion  of  the  image.  In  (a)  this  structure  is 
barely  discernible.  Click  either  image  to  view  its  full  sized  counterpart. 
Click  here  for  a  full  Quicktime  "wiper"  movie  (348  kB)  containing  the 
frames  shown  in  (a)  and  (b). 


Even  if  the  mapping  of  the  two  image  sets  displayed  above  appears  to  be  very  accurate,  close  inspection  of  the  data  reveals  a 
small  remaining  error  in  the  alignment  of  discernible  landmarks.  The  main  causes  of  error  appear  to  be 

1.  Local  tissue  motion  and  deformation  as  caused  by  respiratory  motion  and  compression  of  superficial  tissue  by  the  transducer 
itself.  These  local  deformations  can  be  coirected  only  in  part  by  the  global  geometric  transformation  applied  here  to  register  the 
two  data  sets. 

2.  Noise  in  the  image  sets  or  any  other  inherent  differences  between  the  sets  to  be  registered  as  introduced  by  employing 
different  imaging  modes  or  modalities  (here:  gray-scale  and  f-CDI  ultrasound). 

3.  Changes  in  look  direction  which  cause  changes  in  the  apparent  brightness  of  specular  reflectors  since  the  echo  received  from 
specular  reflectors  strongly  depends  an  the  angle  of  incidence  of  the  ultrasound  pulse.  Even  if  very  apparent  to  the  eye,  this  may 
actually  only  be  a  minor  cause  of  misaligmnent  since  the  volume  covered  by  specular  reflectors  is  small  compared  to  the  totd 
volume,  and  thus  the  mutual  information  affiliated  with  it  contributes  little  to  the  maximization  of  the  total  mutual  information. 

The  quahty  of  the  registration  was  evaluated  by  a  single  observer  as  described  above.  The  mean  ahgnment  error  obtained, 
based  on  13  manually  defined  common  landmarks,  was  1.1  mia  It  should  be  noted  that  this  value  depends  on  the  position  and 
distribution  of  the  selected  points  throughout  the  volume  and  is  somewhat  subjective.  The  peak  alignment  error  estimate  was  2.9 
mm  on  the  left  side  of  the  image  near  the  chest  wall  whose  movability  is  unrelated  to  the  transducer  pressure  applied. 


2.  Extended  3-D  Field  of  View  Imaging 

Figure  4  displays  the  extended  3-D  field  of  view  of  an  invasive  ductal  carcinoma  scanned  in  a  65  year  old  woman.  The 
orientation  and  relative  position  of  the  three  scans  used  to  form  this  extended  view  was  described  in  Figure  1.  In  this  particular 
example,  the  central  (B)  and  medial  (A)  scans  overlapped  about  75%,  the  central  and  lateral  (C)  scans  overlapped  25%,  resulting 
in  a  total  width  of  the  extended  field  of  about  7.9  cm.  In  Figure  4,  the  boundaries  between  the  displays  of  the  coregistered  scans  at 
0.3  and  0.6  of  the  total  width  of  the  extended  view,  marked  by  white  arrows  in  the  2-D  view  of  Figure  4,  are  hardly  noticeable. 
Note  that  no  averaging  or  other  processing  (other  than  slight  image  compression  for  on-line  display)  was  employed  at  the 
boundaries  to  smooth  out  the  transition.  The  display  changes  abruptly  from  scan  A  to  B  and  fix)m  B  to  C,  which  makes  the 
continuous  appearance  of  the  extended  view  even  more  remarkable. 

A  Quicktime  movie  (548  kB)  can  be  displayed  for  appreciation  of  the  quality  of  the  composite  view  throughout  the  volume. 
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Figure  4.  (Top)  3-D  view  of  a  volume  combined  from  three 
parallel,  partly  overlapping  scans  in  a  65  year  old  female  with 
invasive  ductal  carcinoma.  (Bottom)  2-D  view  of  the  axial-lateral 
plane  displayed  in  the  volume  above.  The  width  of  this  extended  view 
is  7.9  cm.  The  boundaries  between  the  original  scans  at  about  one 
third  and  two  thirds  of  the  width  of  the  composite  image  (white 
arrows)  are  hardly  noticeable.  Click  here  for  a  Quicktime  movie 
(548  kB)  displaying  an  elevational  sweep  through  the  extended 
volume.  For  a  high-quality  version  of  the  same  movie  (1.3  MB),  click 
here. 

In  this  example,  commercially  available  high-resolution  transducers,  with  aperture  widths  of  typically  four  cm,  could  have  only 
fully  displayed  one  of  the  masses  at  a  time.  This  limitation  may  make  the  visualization  and  evaluation  of  the  entire  stmcture  using 
ultrasound  more  difficult  In  the  extended  view,  the  three  distinct  masses  are  displayed  simultaneously  in  their  relative  positions  as 
determined  by  the  coregistration  in  the  overlapping  regions.  This  allows  immediate  perception  of  the  entire  region  of  interest  and 
reveals  more  of  the  overall  anatomy  and  anatomical  relationships.  The  large  FOV  should  also  diminish  the  danger  of  missing 
important  details  at  the  edges  and  facilitate  measurements  within  the  extended  volume. 

The  remaining  misalignment  of  the  registered  scans  in  the  overlapping  regions,  based  again  on  visual  inspection  of  identifiable 
stmctures  and  measurement  of  their  apparent  shift,  was  estimated  to  be  0.8  mm  mean  (1.5  mm  peak)  in  the  75%  overlap  region 
and  1.4  mm  mean  (3.1  mm  peak)  in  the  25%  overlap  region. 


3.  Sequential  3-D  Imaging 

Figure  5  shows  an  example  of  a  coregistration  of  sequential  scans  of  a  breast  lesion  in  a  patient  undergoing  CAF 
chemotherapy.  The  65  year  old  woman  had  a  palpable  2.5  cm  mass  and  was  later  diagnosed  with  left  invasive  ductal  carcinoma 
with  a  focal  mucinous  carcinoma  component.  The  two  scans  displayed  here  were  acquired  8  days  before  and  29  days  after  the 
start  of  the  chemotherapy.  Two  more  scans,  obtained  and  coregistered  55  and  78  days,  respectively,  after  the  start  of  tiie  therapy, 
yielded  similar  registration  results  and  are  not  displayed  here. 

Although  the  size  and  shape  of  the  lesion  changed  significantly  between  the  first  two  scans,  the  registration  procedure  aligned 
the  lesions  well  and  allows  better  comparison  and  visuahzation  of  changes  than  without  registration. 
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(c)  (d) 

Figure  5.  Coregistration  of  two  sequential  scans  of  a  breast  lesion  in  a  patient  undergoing 
chemotherapy,  (a)  Central  B-scan  frame  of  the  first  scan,  obtained  one  week  before  the 
start  of  the  therapy,  coregistered  and  transformed  to  map  onto  the  second  scan,  (b) 

Corresponding  frame  of  the  second  scan,  obtained  5  weeks  later,  (c)  Combined  view  of 
the  same  frame  in  the  first  (left)  and  second  scan  (right).  Click  here  for  a  Quicklime 
"wiper"  movie  (304  kB)  showing  the  temporal  changes  throughout  this  frame  by  moving 
the  border  between  the  scans  from  left  to  right,  (d)  Pseudo-color  image  of  the  differences 
between  the  two  scans,  showing  increased  echogenicity  (blue)  where  the  mass  shrank 
(white  arrow),  and  decreased  echogenicity  (yellow)  below  the  mass  (gray  arrow).  Click 
here  for  a  292  kB  movie  displaying  the  differences  throughout  the  scanned  volume. 

Figure  5(a)  and  (b)  show  corresponding  frames  from  the  center  of  the  first  and  second  scan,  respectively,  after  coregistration  of 
the  volumes.  In  this  case,  the  first  scan  was  transformed  using  a  full  affine  transformation  to  map  onto  the  second  one.  In  a  serial 
study  with  scans  obtained  manually  and  several  weeks  apart,  small  changes  in  look  direction  or  positioning  of  the  transducer  are 
unavoidable  even  if  the  sonographer  carefully  tries  to  reproduce  the  field  of  view  of  a  previous  scan.  These  variations  can  make 
direct  comparison  of  two  serid  scans  more  difficult.  However,  if  the  two  scans  have  enough  common  information,  the  registration 
software  can  detect  these  changes  and  transform  one  set  accordingly.  Hence,  the  shght  rotation  of  the  image  in  (a)  can  be 
understood  as  a  correction  for  a  small  change  in  view  direction  between  the  two  scans. 

Figure  5(c)  shows  a  combined  view  of  the  frames  displayed  in  (a)  (left  half)  and  (b)  (right  half  of  the  image),  which  reveals  the 
change  in  size  and  other  characteristics  of  the  lesion.  Also  seen  is  a  small  error  in  aligning  the  specular  reflectors  at  the  top  of  the 
images,  assuming  the  same  tissue  planes  are  producing  the  specular  reflections  in  the  two  scans.  This  near  field  error  is  most  likely 
induced  by  a  local  deformation  of  the  tissue  by  the  pressure  of  the  transducer  against  the  skin.  The  estimation  of  the  average 
misregistration  in  this  serial  study  is  difficult  and  prone  to  error  because  of  the  additional  effect  of  drag-induced  changes  over  time. 
These  changes  cannot  be  unambiguously  separated  from  the  other  causes  of  registration  error  as  discussed  above.  However, 
estimating  the  average  error  by  identification  of  corresponding  landmarks  in  the  two  registered  sets  well  outside  the  tumor  volume, 
a  mean  error  of  1 .4  mm  (peak  2.2  mm)  was  obtained. 

For  better  visual  evaluation  of  the  registration  quality  and  change  in  tumor  size,  a  Quicktime  movie  (304  kB)  can  be  viewed  by 
clicking  here  or  on  the  link  in  the  caption  of  Figure  5(c).  In  the  movie,  the  border  between  the  two  scans  as  displayed  in  (c)  can 
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be  jrioved  from  left  to  right,  thus  revealing  more  of  the  first  or  the  second  scan. 

In  Figure  5(d),  the  change  in  tumor  size  is  highhghted  using  a  pseudo-color  display.  By  simultaneously  feeding  the  gray-scale 
values  of  the  coregistered  firet  scan  into  the  red  and  green  channels  of  a  RGB  (red,  green,  blue)  display  and  the  gray-scale  values 
of  the  second  scan  into  the  blue  channel  of  the  same  display,  a  difference  image  is  created  with  a  color  map  from  yellow 
(echogenicity  of  first  scan  larger)  through  gray  (echogenicities  identical)  to  blue  (echogenicity  of  second  scan  larger).  The 
shrinkage  of  the  hypoechoic  mass  causes  an  increase  in  echogenicity  on  the  mass  periphery  in  the  second  scan  compared  to  the 
first  This  difference  is  clearly  visible  as  a  blue  rim  (white  arrow)  surrounding  the  proximal  half  of  the  mass  in  (d).  The  ^stal  part  of 
the  mass  shows  no  such  blue  rim  and  therefore  appears  to  be  unchanged.  This  may  be  explained  by  the  surroundning  anatomy 
which  can  cause  asymmetric  tissue  deformation  and  displacement  around  the  shrinking  mass. 

The  other  prominent  feature  in  this  figure  is  the  yellow  area  immediately  below  the  tumor  (gray  arrow),  indicating  an  area  of 
decreased  echogenicity.  This  decrease  could  be  explained  by  a  mostly  blood-filled  mass  which  has  lower  attenuation  than  the 
surrounding  tissue  and  thus  causes  an  apparent  enhancement  below  the  mass.  The  smaller  mass  in  the  second  scan  then  causes 
less  enhancement  and  therefore  a  decrease  in  echogenicity,  which  can  also  be  seen  by  comparing  Figures  5(a)  and  (b),  but  which 
is  more  obvious  in  the  color  display  of  (d). 

By  cUcking  here  or  on  the  link  in  the  caption  of  Figure  5(d),  a  movie  (292  kB)  can  be  displayed  showing  the  difference  image 
of  (d)  for  47  frames  of  the  scanned  volume.  Note  the  shriii^ge  of  the  mass  in  all  3  dimensions  by  following  the  blue  rim 
throughout  the  movie.  Quantitative  evaluation  of  the  entire  scans  using  polygons  to  manually  define  the  border  of  the  lesion  in 
each  frame  yielded  a  reduction  in  lesion  volume  of  approximately  27%. 

[  Previous:  Materials  and  Methods  ]  [  Next:  Discussion  ] 
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The  examples  described  are  successful  and  significant  applications  of  image  registration  in  3-D  ultrasound.  They  demonstrate 
the  feasibility  of  a  new  technique  to  improve  ultrasound  diagnostics  and  potentially  open  a  new  range  of  related  applications. 

Routine  coregistration  and  combination  of  image  sets  obtained  using  a  variety  of  different  ultrasound  modes  or  using 
ultrasound  and  a  second  imaging  modality  should  be  possible  with  the  same  or  only  slightly  modified  version  of  the  currently 
used  registration  software. 

In  ultrasound  multimode  imaging,  the  coregistration  should  allow  image  optimization,  i.e.  replacement  of  a  lower  quality 
component  of  one  image  set  with  the  higher  quality  component  of  a  different  set,  as  in  the  substitution  of  high  resolution 
gray-scale  data  for  the  lower  resolution  gray-scale  'background'  of  color  flow  imaging  modes,  as  well  as  image  fusion,  i.e.  the 
combination  of  images  displaying  different  physical  properties,  which  increases  the  diagnostic  value  of  either  one  of  the  original 
images  by  relating  one  physical  property  to  another.  Possible  modes  for  image  fusion  can  include,  but  are  not  restricted  to, 
frequency-shift  and  power  mode  Doppler,  harmonic  imaging,  and  new  modes  being  researched  and  developed  such  as  imaging 
with  contrast  agents  or  ultrasound  elasticity  imaging  (27,  28).  The  quality  of  the  registration  will  depend  on  the  information 
content  of  the  images,  more  specifically,  the  mutud  information.  Where  only  gray-scale  information  was  employed  for  the 
registration,  the  accuracy  did  not  allow  an  exact  pixel  by  pixel  match,  but  the  registration  was  far  better  than  can  be  done 
manually. 

In  multimodal  imaging,  coregistrations  of  ultrasound  scans  with  MR,  CT,  and  other  3-D  data  sets,  or  with  projection  images 
such  as  mammograms  can  be  envisioned.  If  ultrasound  scans  are  obtained  in  the  same  or  a  similar  geometry  as  for  a  mammogram, 
a  coregistration  of  a  projection  of  the  ultrasound  scan  with  the  mammogram  could  combine  the  most  inexpensive  and  commonly 
used  modalities  for  breast  imaging.  This  would  add  3-D  information  to  tiie  2-D  mammogram  and  allow  more  accurate  tracking  of 
spots  identified  in  the  mammogram  using  3-D  ultrasound. 

The  extended  3-D  field  of  view  is  a  method  to  overcome  one  of  the  major  disadvantages  of  ultrasound  imaging  compared  to 
most  other  modalities:  the  very  limited  field  of  view  and  unsystematic  coverage  of  the  region  of  interest.  In  breast  imaging,  a  wider 
field  of  view  should  be  particularly  desirable  in  following  suspicious  regions  and  in  detection  of  preclinical  disease.  To  follow  in 
3-D  the  morphology  of  a  large  lesion  and  its  effect  on  the  surrounding  tissue,  a  larger  field  of  view  will  be  essential.  A  combination 
of  extended  field  of  view  and  multimode  (gray-scale  and  CDI)  imaging  would  even  allow  tracking  of  vascular  and  tissue 
morphology  simultaneously  in  high  quality  images.  Screening  of  women  at  veiy  high  risk  for  breast  cancer  is  beginning  to  draw 
more  interest  in  the  US  with  incidental  detection  of  malignant  foci  at  locations  removed  from  the  site  of  suspicion  ( 29 ). 
Accordingly,  the  extended  field  of  view  is  likely  to  increase  the  sensitivity  of  ultrasound  in  breast  cancer  detection.  A  wider  field  of 
view  will  also  help  in  covering  previously  scanned  sites  and  thus  determining  changes  over  time,  either  in  screening  of  high  risk 
groups,  tracking  suspicious  regions,  or  monitoring  response  to  treatment.  While  radiologists  and  sonographers  can  reach  very  high 
skill  levels,  it  is  often  difficult  for  some  operators  to  assure  that  the  same  views  are  obtained  in  two  or  more  serial  studies. 
Interpretation  is  also  compUcated  when  the  interpreter  has  not  personally  performed  the  exam.  Both  problems  could  be  reduced 
using  3-D  extended  FOV  ultrasound  imaging. 

The  accuracy  of  coregistrations  of  partly  overlapping  volumes  appears  to  depend  on  the  size  of  the  overlap.  It  is  possible  that 
the  larger  the  overlap,  tiie  more  common  structure  is  available  to  align  the  scans,  and  the  less  the  registration  algorithm  is 
potenti^y  affected  by  noise.  The  minimum  overlap  required  for  acceptable  registration  accuracy  can  vary  with  the  information 
content  of  the  data  sets.  However,  in  the  examples  studied  so  far,  a  1  cm  (25%)  overlap  generally  produced  acceptable 
registrations,  judged  by  visual  inspection. 

For  serial  exams,  the  extended  field  of  view  technique  might  be  combined  with  coregistration  of  scans  obtained  at  different 
times.  This  would  allow  the  visualization  and  quantification  of  changes  in  large  lesions  over  time.  In  fact,  the  acquisition  and 
composition  of  an  extended  field  of  view  might  prove  to  be  necessary  for  trackmg  rapidly  changing,  large  lesions  because  in  this 
case  a  small  field  of  view  might  not  contain  enough  unchanged  structure  (which  is  usually  found  well  outside  the  volume  of  the 
mass)  for  the  coregistration  to  work  properly.  If  routinely  used  in  serial  exams  of  women  with  high  risk  of  breast  cancer, 
coregistration  could  help  detect  early  changes  not  apparent  in  multiple  small  FOV  scans,  thus  increasing  the  chances  of  effective 
treatment. 

The  advantages  of  image  registration  in  3-D  ultrasound  may  be  more  fully  employed  by  using  new  display  techniques  such  as 
the  difference  image  shown  in  Figure  5(d).  Using  this  type  of  (fifference  image  it  may  be  possible  to  segment  regions  of  shrinkage 
and  growth  for  rapid,  semiautomatic  volume  change  estimations. 

For  validation  of  quantitative  measurements  made  in  coregistered  image  sets,  an  automated  error  estimation  is  desirable.  The 
quality  of  coregistrations  can  vary  strongly  with  the  available  mutual  information,  which  depends  on  the  amount  of  shadowing, 
specular  reflectors,  and  local  tissue  deformation  present  in  the  image  sets.  Manual  evaluation,  as  in  the  examples  presented  here, 
may  not  be  practical  to  assure  accuracy  of  quantitative  measurements  of  dimensions  over  long  distances. 
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Abstract  — We  demonstrate  die  ability  to  re^ster  easily  and  accnrately  volmnetric  nltrasoond  scans  sdthont 
significant  data  preprocessing  or  nser  interventioii.  Tvo  vdiimettic  nltrasonnd  breast  scan  data  sets  trere 
acquired  from  two  dilTerent  patients  with  breast  cancer.  Voiametric  scan  data  were  acquired  by  mannally 
sweeping  a  linear  array  transducer  mounted  on  a  linear  dider  with  a  position  encoder.  The  volumetric  data  set 
pairs  consisted  of  color  flow  and/or  power  mode  Doppler  data  sets  acquired  serially  on  the  same  patients.  A 
previously  described  semiautomatic  registration  mediad  based  on  masimiring  mutual  infoimation  was  used  to 
determine  the  transform  between  data  sets.  The  results  suggest  diat,  even  for  the  deformable  breast,  three- 
dimensional  (bn  afiSne  transforms  ran  be  sufficient  to  obtain  clinical  usefbl  re^strations;  warping  may  be 
necessary  for  increased  re^stration  accuracy,  in  condnsion,  mutual  information-based  automatic  regishation  as 
implemented  <m  modem  woricstations  is  capable  of  yiddlng  dfadcany  usefid  registratioiis  in  thnes  <35  min. 
®  1998  World  Federation  for  Ultrasound  in  Medidne  &  Bidogy. 

Key  Wards:  Ultrasound,  Mutual  informatioii,  R^stration,  Volumetric,  affine.  Thin  plate  spHne  warping. 


INTRODUCTION 

There  are  potentially  many  reasons  why  ultrasound 
examinations  might  benefit  from  registration,  hn^es 
fixim  different  transducer  positions  are  at  least  partially, 
if  not  fiilly,  uncorrelated,  and  summing  them  can  signif¬ 
icantly  improve  the  contrast-to-speckle  noise  ratio. 
Doppler  color  flow  acquisitions  suffer  fiom  undetected 
fiow  where  the  flow  is  parallel  to  the  transducer’s  face. 
Volumes  collected  fiom  different  viewing  directions 
may  detect  such  missing  flow  vectors,  and  registration 
across  acquisitions  can  assist  in  computing  flow  velocity 
vectors  that  are  consistent  across  different  views.  Per¬ 
haps  the  most  important  reason  to  register  ultrasound 
data  sets  is  to  assist  the  comparison  of  serial  examina¬ 
tions  performed  on  the  same  patient  Presenting  two- 
dimensional  images  &om  different  serial  examinations 
with  the  same  orientation  and  partial  volumes  may  help 
the  clinician  more  easily  to  distinguish  what  has 
changed.  To  the  extent  that  echogenicities  from  (Cerent 
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examinations  can  be  approximately  equalized,  registered 
serial  examinations  can  be  subtracted  to  emphasize 
changes.  Such  differential  .q>proaches-  could  be  espe¬ 
cially  important  when  serially  monitoring  patient  re¬ 
sponse  to  chemotber^y  or  radiation  Iher^y. 

Although  such  automatic  registration  methods  for 
ultrasound  data  sets  may  be  desirable,  there  are  prelim¬ 
inary  reasons  for  caution  in  expecting  automatic  methods 
to  function  well  Such  reasons  include  the  ubiquitous 
speckle  noise  and  attenuation  artifacts  such  as  “comet 
tails”  of  either  shadowing  or  enhancement  Attenuation 
artifacts  that  present  differently  in  each  of  the  data  sets 
depending  on  transducer  orientation  may  compromise 
chances  of  successful  registration  for  any  automatic 
method.  An  additional  source  of  inconsistent  features 
comes  from  strong  coherent  echoes  that  are  observed 
fixjm  structures  large  with  respect  to  wavelength  when 
observed  in  an  orientation  normal  to  the  reflecting  sur-’ 
face.  Thus,  coherent  echoes  as  well  as  shadows  in  dif¬ 
ferent  data  sets  are  often  sources  of  inconsistent  geom¬ 
etry  when  the  data  sets  were  acquired  using  different 
transducer  orientations.  Refiraction,  i.e.,  ray  bending, 
may  yield  additional  inconsistencies. 


2 


Ultrasound  in  Medicine  and  Biology  Volrnne  24,  Number  9,  1998 


a)  b)  c)  d)  e) 

Fig.  1.  A  simplified  two-dimensional  example  of  the  registration  process  is  illustrated,  (a,  b)  Two  “multimodal”  images 
in  which  the  user  has  poorly  chosen  approximate  homologous  points,  (c)  Geometric  registration  that  maps  the 
corresponding  maricers  onto  each  other  after  the  user’s  inidaiization,  but  before  automatic  optimization  begins.  After 
initialization,  although  the  maricers  are  perfecdy  ah'gned,  the  images  are  still  misregistered.  (d)  Resulting  final 
registration  obtained  by  the  optimizer’s  driving  &e  locations  of  the  homologous  points  in  (b)  to  minimize  the  cost 
function,  -I,  Le.,  maximizing  L^ote  that  the  position  of  the  upper  maricer  in  (b)  has  been  moved  by  the  optimization 
process  to  a  new  position.  (Reproduced  with  permission  ftom  Oxford  University  Press  from  Medicd  Image  Analysis 
^  ,  /  1997;3:195-20ti.)  ' 


The  following  paragraphs  describe  the  use  of  a 
semiautomatic  registration  technique  that  appears  to  be 
capable  of  registering  ultrasound  data  sets  based  on  the 
preliminary  information  presented  herein.  The  term 
“semi”  qualifies  the  description  of  the  otherwise  totally 
automatic  method  because  the  initial  pose  between  the 
two  data  sets  must  be  set  by  the  user.  At  present,  the 
authors  are  unaware  of  any  semi-  or  fully  automatic 
registration  algorithms  that  have  been  applied  success¬ 
fully  to  ultrasound  data  volumes.  A  recent  review  of 
registration  techniques  in  general  can  be  seen  in  Maintz 
and  Viergever  (1998). 

METHODS 

Volumetric  ultrasound  data  were  acquired  using  a 
9-MHz  linear  array  clamped  to  a  linear  slide  and  position 
encoder  on  a  hand-held  firame  (Fenn  et  al.  1997).  The 
transducer  manually  was  swept  across  the  tissue  of  in¬ 
terest  in  a  direction  normal  to  the  linear  array’s  scanning 
plane.  Accuracy  of  beam  position  measurement  relative 
to  the  scan  &ame  was  0.1  mm  in  the  focal  plane  of  the 
transducer.  Data  volumes  on  a  uniform  Cartesian  grid 
were  created  by  trilinear  interpolation  between  acquired 
images  firom  known  positions. 

Pairs  of  such  ultrasonic  volumes  were  registered 
using  a  method  that  requires  an  initial  rough  guess  of  the 
orientation  between  the  two  data  sets.  As  can  be  seen 
later  in  the  Results  section  for  the  random  void  phantom, 
the  initial  orientation  may  be  far  from  accurate,  but  will 
still  within  the  capture  range  of  the  algorithm  and  result 
in  an  accurate  registration.  The  initial,  approximate  ori¬ 
entation  is  computed  by  having  the  user  position  a  min¬ 
imum  of  three  corresponding  point  pairs  in  each  data 
volume.  One  of  the  data  sets  is  chosen  by  the  user  as  the 
reference  data  set,  and  the  other  data  set,  which  will  be 
geometrically  transformed  onto  the  reference,  is  referred 


to  as  the  homologous  set  Points  in  both  sets  are  depos¬ 
ited  by  clicking  tiie  computer’s  mouse  as  the  cursor  is 
positioned  manually  over  similar-looking,  three  features. 
Then,  under  automatic  control  of  the  optimizer,  the  first 
three  points  in  just  the  homologous  data  set  are  moved  to 
recompute  different  geometric  orientations  of  the  homol¬ 
ogous  data  set  with  respect  to  the  reference  data  set  The 
points  in  the  homologous  data  set  are  referred  to  as 
control  points,  because  the  geometric  orientation  be¬ 
tween  the  two  data  sets  is  changed  to  satisfy  the  homol¬ 
ogy  defined  by  the  control  points.  The  automatic  opti¬ 
mizer  repeatedly  perturbs  die  loci  of  the  control  points  in 
the  homologous  data  set,  such  that  the  resulting  mutual 
information,  as  computed  for  all  voxels  in  the  reference 
volume  and  all  corresponding  voxels  in  the  homologous 
volume,  is  maximized  to  yield  the  final  computed  regis¬ 
tration  model  between  the  two  data  sets  (Collignon  et  al. 
1995;  Meyer  et  al.  1997;  Studholme  et  al.  1997;  Viola 
and  Wells  1995;  Wells  et  al.  1996).  Hgures  1,  2,  and  3 
help  visualize  the  interplay  among  the  control  points,  the 
computation  of  mutual  information,  and  the  recursive 
optimizer  algorithm. 

The  entropy  of  a  data  set  is  defined  as  its  average 
information  content,  whereas  joint  entropy  is  the  average 
information  of  two  ordered  data  sets.  The  joint  entropy 
H(a,b)  of  two  data  sets,  a  and  b,  is  related  to  mutual 
information  of  both,  I(a,b),  by  the  following  classic  re¬ 
lationship: 

H(a,A)  =  H(a)  +  H{b)  -  I{a,b)  (1) 

where  H(a)  and  H(b)  are  the  individual  entropies  of  data 
sets  a  and  b,  respectively  (Papoulis  1984).  As  can  be  seen 
in  the  classic  relationship,  mutual  information  I(a,b)  is 
the  amount  by  which  the  sum  of  the  individual  data  set 
entropies  must  be  reduced  to  account  for  correlations  that 
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Mapping  of  voxeH  onto  voxel2  and  Associated  Joint  density 

under  current  geometric  assumptions  histogram  cell  modification 


Fig.  2.  Two-dimensional  joint  histogram  constructed  by  raster  scanning  through  all  voxels  in  the  reference  image  set  and 
incrementing  bin  counts  corresponding  to  the  gray-scale  values  from  geometrically  mapped  voxel  pairs  under  an 
assumed  geometric  transformation,  which  changes  with  each  iteration  of  the  optimizer.  (Reproduce  with  permission 
firom  Oxford  Uitiversity  Press  from  Medical  Image  Analysis  1997',3.T95-206^  ^ 


exist  between  die  two  individual  data  sets  (H  and  I  are 
non-negative).  The  previous  expression  defining  mutual 
information  in  relation  to  entropies  reduces  to  the  fol¬ 
lowing  equation  for  mutual  information  in  terms  of  the 
more  fundamental  probability  density  functions  for  data 
sets  a  and  b: 


da  db  p(ab)  log(p(c0)/p(a)p(i)).  (2) 


The  initial  geometric  transform  model  optimized 
via  moving  the  initial  three  control  points  is  the  simple, 
rotate-translate  (six  degrees  of  freedom)  transform.  In  a 
subsequent  optimization,  the  parameters  for  a  full  affrne 


(linear,  12  degrees  of  fireedom)  transform  are  estimated 
via  four  control  points  (th^three  previous  plus  one  new 
control  point  positioned'^tomatically  into  the  homolo¬ 
gous  data  set  using^e  previously  optimized  rotate- 
translate  transfmn).  Finally,  if  desired,  repeated  thin 
plate  spline^arpings  are  computed  using  five  or  more 
control  poi^  as  necessary,  where  the  previous  full  affine 
optimum  transform  is  used  to  instantiate  the  additional 
control  points.  In  this  manner,  the  mutual  information  is 
optimized  at  each  stage  of  increasing  geometric  model 
complexity,  while  requiring  the  user  only  roughly  to 
estimate  approximate  geometric  homology  for  the  three 
initial  points.  The  additional  control  points  beyond  the 
first  three,  which  eventually  are  mapped  into  the  homol¬ 
ogous  data  set,  initially  are  placed  in  the  reference  data 


Fig.  3.  Functional  flow  chart  of  the  automatic  registration  algorithm  for  one  optimization  cycle.  The  process  is  repeated 
using  the  previously  computed  optimized  control  point  positions  as  the  new  starting  vector,  until  the  incremental  change 
in  mutual  information  between  cycles  falls  below  a  user  set  threshold,  typically  0.0002  bits.  (Reproduced  with 
permission  from  Oxford  University  Press  from  Medical  Image  Analysis  1997;3:195-206.) 
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Hg.  4.  (a)  Image  fix3m  the  red  channel  of  a  color  flow  volume  breast  examination,  (b)  Pseudocolored  image  of  (a). 
Lowest  echogenicities  are  represented  by  dark  blue,  intermediate  echogenicities  by  green,  and  highest  echogenicities  by 
bright  red  hues.  Color  mapping  relationship  is  explicitly  demonstrated  in  the  attached  gray-scale  and  color  bars,  (c) 
Power  mode  data  corresponds  to  same  loci  as  the  color  flow  slice  of  a  following  registration,  (d)  Composite  image 
constructed  using  “screen  door”  transparency,  where  adjacent  pixels  alternate  between  the  color  and  gray-scale  sources 

of  (b)  and  (c). 


set  by  the  user,  without  identification  of  corresponding 
positions  in  the  homologous  data  set 

Uniformly  sampled  data  volume  sizes  are  approxi¬ 
mately  400  X  350  X  55-100  voxels  depending  on  the 
manual  acquisition;  voxel  volumes  are  typically  80  X 
80  X  200  ^un^.  The  registrations  computed  herein  use 
decimated  reference  data  sets  to  speed  computation.  Dur¬ 
ing  the  initial  use  of  the  rotate-translate  model,  only 
every  fourth  voxel  in  the  three  major  coordinate  direc¬ 
tions  is  used  in  the  reference  data  sets.  Each  optimization 
cycle  stops  when  the  controller  requests  control  point 
movements  of  less  than  some  user  chosen  criterion, 
selected  here  as  0.1  mm,  in  each  coordinate  direction. 
The  optimizer  is  the  standard  Nelder  simplex  algorithm, 
often  referred  to  as  “amoeba”  (Press  et  al.  1988).  Opti¬ 
mization  cycles  are  repeated  until  the  mutual  information 
increment  in  the  last  cycle  is  less  than  or  equal  to  another 
user  chosen  criterioni  selected  here  and  for  almost  all 
other  modality  pairings  as  0.0002.  After  computing  the 
optimal  forward  transform,  which  maps  the  homologous 
data  set  onto  the  reference,  the  high-resolution  mapping 
of  every  voxel  of  the  reference  data  set  onto  the  homol¬ 
ogous  is  computed  once,  using  the  inverse  transform. 


RESULTS 

The  first  registered  volumetric  data  set  pair  shown 
in  Hg.  4  consists  of  color  flow  and  power  mode  Doppler 
data  sets  acquired  serially  during  the  same  patient  exam¬ 
ination  visit  A  three-dimensional,  nine  control  point  (27 
degrees  of  freedom)  fliin  plate  spline  warping  was  com¬ 
puted  in  3 1  min  of  CPU  time  on  a  200-MHz  DEC  Alpha 
workstation,  model  3000/500x,  using  a  total  of  1552 
iterations  (where  each  iteration  consists  of  calculating 
the  geometric  transformation,  reconstruction  of  the 
mapped  homologous  gray-scale  volume,  joint  histogram, 
and  resulting  mutual  information) .  The  red  chaimel  of 
each  data  set  pair  was  used  to  compute  the  geometric 
mapping.  Although  radiologists  commonly  avoid  the  use 
of  pseudocolored  images,  such  composite  images  assist 
in  visualizing  the  results  of  registration.  Display  of  the 
registered  data  sets  as  shown  in  Fig.  4d  enhances  visual 
differentiation  of  the  individual  image  sources  and  facil¬ 
itates  the  visual  assessment  of  registration  accuracy  at  all 
locations  in  a  single  image. 

Figure  5  allows  the  reader  to  assess  the  accuracy  of  FS 
the  volumetric  registration  over  a  large  volume  of  sup- 
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Fig.  5.  View  of  the  registered  color  flow  and  power  mode  volumes  visualized  on  three  orthogonal,  intersecting  cut  planes 
using  a  color  composite  rendering  method  that  approximates  the  screen  door  transparency  shown  in  Fig.  4d.  The 
observer’s  viewpoint  presented  here  is  one  of  looking  back  at  the  transducer  firom  a  dist^  position  deep  within  the  breast 
(top  of  the  image  is  still  patient’s  anterior).  The  cut  plane  whose  orientation  is  nearly  perpendicular  to  the  viewer  is  the 
same  inmge  as  that  shown  in  Hg.  4d,  where  the  underlying  gray-scale  image  represents  one  of  the  (high  resolution) 
acquisition  planes  of  the  color  flow  data  volume.  The  intersecting  cut  plane  across  the  top  of  the  volume  renders  the 
registration  at  a  constant,  shallow  depth  below  the  transducer  (C-mode),  and  the  remaining  cut  plane  right  of  center 
renders  a  slice  of  the  registered  volume  below  the  line  traversed  by  a  single  transducer  element  during  the  manual  sweep 
of  tire  transducer.  The  color  bars  that  define  the  pseudocolor  conversion  for  the  reference  scan  is  visible  on  the  reader’s  left 


port.  The  color  composite  display  computes  the  relative 
color  contribution  to  each  voxel,  based  on  a  linear  com¬ 
bination  of  the  intensities  of  the  voxels  of  the  two  reg¬ 
istered  input  volumes.  The  orthogonal  cut  plane  method 
of  display  was  chosen  because  of  its  clarity,  intuition, 
freedom  from  confusing  intervening  structures,  and  the 
ability  simultaneously  to  display  spatially  diverse,  three- 
dimensional  locations. 

Hgure  6a  demonstrates  the  effects  of  the  computed 
geometric  warping,  by  applying  the  same  warping  to  a 
rectilinear  grid  occupying  the  power  mode  volume.  Fig¬ 
ures  6b- 6d  show  views  of  the  deformation  from  the 
right,  front,  and  top,  respectively.  Note  that  the  major 
component  of  the  geometric  transform  is  a  simple  affine 


transformation,  as  best  seen  in  Rg.  6d,  where  the  volume 
has  been  sheered  to  the  left  as  a  function  of  distance 
away  from  the  observer,  Le.,  transducer  position.  Upon 
closer  inspection,  a  nonlinear  warp  can  be  observed  in  the 
front  cen^  section  of  the  volume,  the  same  region  occu¬ 
pied  by  tire  lesion,  indicating  that,  during  fire  second  scan, 
the  lesion  moved  differently  than  the  surrounding  tissue. 

The  second  pair  of  registered  volumetric  data  sets 
presented  here  consists  of  two  power  mode  Doppler  data 
sets  acquired  on  the  same  patient  and  separated  by  45  d 
during  chemotherapy  for  locally  advanced  infiltrating 
ductal  carcinoma.  In  contrast  to  the  previous  case,  the 
registration  model’s  complexity  was  capped  at  the  level 
of  the  full  affine  (linear,  12  degrees  of  freedom)  trans- 
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Fig.  6.  (a)  Computed  geometric  warp  of  the  power  mode  volume  is  demonstrated  by  applying  the  same  warp  to  a 
rectilinear  grid  occupying  the  initially  undistortrf  power  mode  volume,  (b,  c,  d)  Views  of  *e  warped  deformation  from 
the  right,  front,  and  top  of  the  scanned  volume,  lespectively. 


form  due  to  the  resulting  excellent  overall  accuracy,  as 
determined  visually.  Computing  this  transform  from  the 
initial  rough  estimate  required  909  total  iterations  over 
the  period  of  11.3  min.  As  in  the  previous  case,  the  red 
channel  of  each  pair  was  used  for  computing  the  geo¬ 
metric  mapping  and  display  of  results.  Figure  7a  shows 
three  orthogonal  cut  planes  through  the  registered  data 
set  volumes,  as  visualized  from  a  position  above  the 
transducer  looking  deeper  into  the  scanned  volume.  Note 
the  shear  (most  appreciated  on  the  plane  nearly  perpen¬ 
dicular  to  the  viewer)  required  to  register  the  data  sets. 
Kgure  7b  is  a  single  slice  of  the  more  recent  data  set,  and 
Fig.  7c  shows  the  data  from  the  earlier  scan  correspond¬ 
ing  to  the  geometry  of  the  slice  shown  in  Fig.  7b  obtained 
after  volumetric  registration.  Because  the  two  cases  were 
performed  with  nearly  equivalent  depth-gain  compensa¬ 
tion,  equalization  of  the  echogenicities  of  both  scans  was 
trivially  achieved  using  linear  gray-scale  contrast  adjust¬ 
ment  Hgure  7d  demonstrates  the  signed  difference  be¬ 
tween  the  two  scans,  where  the  yellow  hue  represents 
differences  of  positive  sign,  the  blue  hue  represents  dif¬ 
ferences  of  negative  sign,  and  the  intensity  for  each  hue 
is  proportional  to  the  magnitude  of  the  difference.  Al¬ 


though  some  bright  horizontal,  linear,  coherent  struc¬ 
tures  clearly  are  represented  in  the  difference  image,  a 
lower  contrast  echogenic  structure  also  is  visualized  (ar¬ 
row),  Le.,  present  in  the  earlier  data  set  but  missing  in  the 
later  volume. 

In  addition  to  the  two  breast  data  sets  presented 
herein,  we  include  results  from  scanning  a  commercially 
available,  random  void  phantom  in  two  different  orien¬ 
tations.  The  phantom  is  made  by  Computerized  Imaging 
Reference  Systems,  Inc.  (Norfolk,  VA,  USA)  and  con¬ 
sists  of  two  slabs  of  randomly  placed  spherical  voids 
surrounded  by  a  random  scattering  medium  having  an 
attenuation  of  0.5  dB  cm“^  MHz“*.  One  slab  consists  of 
5-mm  diameter  voids,  and  the  other  consists  of  3-mm 
diameter  voids.  The  two  slabs  are  separated  by  a  voidless 
slab  consisting  of  the  same  random  scattering  medium 
used  to  surround  the  voids  in  the  other  slabs.  Scattering 
from  the  voids  averages  14  dB  down  from  the  surround¬ 
ing  random  scattering  medium.  Nylon  fibers  run  parallel 
to  the  slabs  at  depth  ranges  of  2  and  6  cm. 

One  volumetric  scan  acquisition  was  made  by  man¬ 
ually  translating  the  transducer  parallel  to  the  sides  of  the 
phantom  and,  thus,  parallel  to  the  wall  of  spherical  voids 
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Kg.  7.  (a)  Orthogonal  cut  planes  through  the  registered  power  mode  data  set  volumes  from  seiial^exa^ations 
visualized  from  a  position  above  the  transducer  looking  deeper  into  the  scanned  volume.  The  pseudocplofed  volume  was 
acquired  45  d  earUer  than  the  gray-scale  volume,  (b)  Single  slice  of  the  more  recently  acquirc^data  set.  (c)  Data  irom 
the  earlier  scan  corresponding  to  the  geometry  of  slice  (b)  after  volumetric  registratioi^asjbeen  implemented;  (c)  also 
is  visible  as  the  pseudocoloied  component  in  (a),  (d)  Signed  difference  between  (b)  and  where  the  two  hues  represent  ^{p 
differences  of  opposite  sign,  whereas  intensity  of  each  hue  is  proportional  to  die  magnitude  of  the  difference.  In  die  color 
bar,  a  difference  of  +127  is  represented  by  bright  yellow,  a  difference  of  zero  is  black  (center  of  bar),  and  a  difference 

of  - 128  is  bright  blue. 


with  the  transducer  held  approximately  perpendicular  to 
the  phantom’s  surface.  The  second  scan  was  taken  by 
reorienting  the  translation  path  45°  to  the  initial  position 
using  a  draftsman’s  triangle.  Thus,  in  the  second  scan, 
the  transducer  remained  approximately  perpendicular  to 
the  phantom’s  surface,  whereas  the  path  of  the  translated 
transducer  crossed  the  wall  of  voids  diagonally.  The 
initial  poor  placement  of  the  starting  markers  was  inten¬ 
tional,  to  demonstrate  to  the  reader  how  severe  misreg¬ 
istration  of  features  appears  (Fig.  8a)  using  the  display 
technique  shown  in  Figs.  4  and  5,  where  blended  pseudo¬ 
color  and  gray-scale  scans  demonstrate  the  large  capture 


range  of  the  automatic  registration  algorithm.  Note  that 
the  bright  gray-scale  line  in  the  homologous  data  volume 
represents  the  same  nylon  fiber  in  the  phantom  as  the  red 
pseudocolor  line  in  die  reference  volume.  The  angular 
misregistration  is  readily  parent  between  the  two  data 
sets.  Note  that  the  voids  appear  to  be  filled  with  higher 
level  scattering,  due  to  the  misregistration  of  the  two  data 
volumes. 

The  results  of  the  final  registration  are  presented  in 
Rg.  8b.  The  linear  nylon  fiber  in  the  homologous  data  set 
has  been  superimposed  with  the  red  pseudocolored  ref¬ 
erence  data  volume  fiber.  The  linear  fiber  superimposi- 
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Hg.  8.  (a)  Mtial  pose  of  the  45®  diagonal  scan  of  void  phantom  in 
gray  scale  with  0°  reference  scan  in  pseudocolor  is  displayed  on 
three  orthogonal  planes  through  data  volume.  Note  the  fiUpH 
^pearance  of  the  voids  as  well  as  the  lack  of  alignment  of  the 
linear  nylon  fiber  in  this  initially  misregistered  pose.  The  reference 
data  set  is  shown  in  pseudocolor,  with  the  same  color  conversion 
relationship  used  previously,  (b)  The  same  display  of  reference 
data  set  shown  in  (a)  after  automatic  registration  of  the  volumetric 
45®  scan  with  the  reference  0®  scan.  Note  that,  after  registration, 
the  voids  have  more  contrast,  because  they  are  not  inqipreptiately 
filled,  with  misregistered  scatterers,  and  the  nylon  fiber  in  the  43® 
scan  is  nearly  collinear  with  its  position  in  the  reference  volume. 

V 

tion  is  nearly  perfect  to  the  viewer’s  right,  whereas  a 
slight  misregistration  can  be  observed  to  the  viewer’s 
left,  as  a  partial  separation  of  both  bright  gray  and  red. 
This  slightly  visible  error  correlates  well  with  the  com- 
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puted  angles  of  -1.0°,  -45.4°,  and  -0.5°  for  0^,  0^,  and 
02,  respectively,  of  the  rotate-translate  approximation  to 
the  computed  full  affine  geometric  transformation  ma¬ 
trix;  we  would  expect  0°,  45.0°,  and  0°  for  a  perfect 
result  The  mutual  information  of  the  initial  pose  was 
0.064  bits,  which  was  optimized  to  0.229  bits  in  17 
cycles  of  1025  total  iterations  under  the  rotate-translate 
geometry  model,  and  finished  at  0.383  bits  after  16 
additional  cycles  consisting  of  a  total  of  1869  iterations, 
using  the  full  affine  geometry  model.  It  is  worth  noting 
that  simple  low-pass  filtering  of  the  two  data  sets  signif¬ 
icantly  speeds  the  convergence  of  the  registration  igo- 
rithm,  by  reducing  the  grand  total  of  all  iterations  to 
1200,  which  require  total  compute  times  <9  min  on  a 
433-MHz  DEC  Personal  Alpha  workstation. 

DISCUSSION 

Volumetric  registration  was  computed  in  all  cases 
using  a  full  affine  transform  as  the  first  endpoint  If  the 
resultant  registration  was  judged  by  visual  inspection  to 
be  flawed  in  local  regions,  a  higher  degree  of  freedom 
geometry  model,  Le.,  warping,  was  computed.  Thus,  the 
thin  plate  spline  warping  of  the  data  set  associated  with 
Rgs.  1  and  2  was  implemented  using  both  a  mnnber,  Le., 
nine,  and  placement  of  control  poMts  that  resulted  in  a 
better  global  solution.  The  hn^roved  accuracy  of  the 
registration  resulting  fronv-W^ing  was  determined  both 
visually  and  quantitanvely  by  the  increase  in  the  final, 
optimized  mutuaflinforination,  Le.,  a  significant  27% 
increase  in(m  was  observed  from  0.805  for  the  full 
affine  solution  to  0.827  for  the  nine  point  TPS  solution.  aq:2 
The  presence  of  a  small  mass  with  different  elastic  mod¬ 
ulus  than  the  sunounding  tissue  is  suggested  by  observ¬ 
ing  the  nonlinear  warping  depicted  in  Fig.  3,  because  the 
computed  tissue  deformation  indicates  a  local  rotation. 

This  rotation  could  have  been  in  response  to  the  overall 
deformation  caused  by  the  pressure  of  the  transducer  on 
the  skin  in  the  process  of  scanning. 

For  the  case  of  the  void  phantom,  although  the  error 
associated  with  0y  was  <0  J°  from  the  expected  value  of 
45°,  the  error  of  1°  in  0^  can  be  explained  by  our  inability 
accurately  to  mount  the  transducer  perpendicular  to  the 
plane  of  the  manual  translation  baffie.  Any  deviation 
away  from  90°  in  the  angle  subtended  by  the  rotation  of 
the  autoscanning  plane  of  the  transducer  into  that  of  the 
manual  scanning  baffle,  Le.,  0^,  will  require  compensa¬ 
tion  by  both  02  and  0^,  depending  on  the  rotation  im¬ 
posed  on  0y.  Additional  registration  accuracies  using 
phantom  data  from  computed  tomography,  magnetic  res¬ 
onance  imaging,  and  positron  emission  tomography,  are 
available  in  Meyer  et  al.  (1997).  Although  no  prepro¬ 
cessing  was  necessary  for  the  phantom  data  to  obtain 
accurate  registrations,  a  >50%  decrease  in  registration 
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time  was  obtained  by  low-pass  filtering  the  input  data 
sets  before  registration.  Such  behavior  should  be  ex¬ 
pected,  because  low-pass  filtering  increases  the  long 
range  correlations  in  the  data  sets  and  smoothes  the 
resulting  cost  function,  such  that  convergence  can  be 
obtained  without  entrapment  by  many  local  maxima. 

Because  bright,  linear  structures  in  the  scanned  vol¬ 
ume  occur  when  the  transmitted  beam  is  perpendicular  to 
an  echogenic  surface,  a  lack  of  overlapping  alignment  of 
such  linear  structures  is- expected,  due  to  the  variation  in 
transducer  angles  used  to  acquire  the  different  volumes. 
Conversely,  good  registration  of  less  intense,  incoherent 
backscattering  structures  is  expected  and  should  be  used 
as  an  independent  visual  evaluation  tool  for  qualitatively 
judging  the  accuracy  of  the  registration. 

The  robust  behavior  of  the  previously  developed 
mutual  information  for  automatic  multimodalily  image 
fusion  (MIAMI  Fuse)  registration  algorithm  (Meyer  et 
al.  1997)  for  these  pairs  of  same-modality,  Le.,  ultra¬ 
sound,  data  sets  was  a  pleasant  surprise.  No  preprocess¬ 
ing  of  the  data  sets,  such  as  speckle  reduction,  was 
necessary,  and  the  resulting  registrations  were  of  excel¬ 
lent  quality  and  were  obtained  in  relatively  short  times. 
Even  the  demanding  task  of  warping  using  nine  control 
points,  Le.,  27  degrees  of  freedom,  yielded  accurate, 
repeatable  registrations,  a  feat  even  the  authors  initially 
considered  as  unlikely. 
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Normslizing  Fractloaial  Moiriaig  Blood  Voliame 
Estimates  witli  Power  Doppler  US:  Defining 
a  Stable  lntra¥asoiiIar  Point  with  tbe  Ciimialati¥e 
Power  Distribution  Function^ 


PURPOSE:  To  normalize  the  power 
Doppler  ultrasound  (US)  signal  to 
the  expected  signal  from  100%  blood 
in  the  calculation  of  a  fractional  mov¬ 
ing  blood  volume  estimate. 

MATERIALS  AND  METHODS:  To 
locate  the  signal  from  flowing  blood 
with  a  consistent  backscatter  coeffl* 
cient,  the  authors  estimated  the  knee 
of  the  cumulative  Doppler  power 
distribution  function.  They  used  a 
flow-tube  phantom  to  test  the  use  of 
this  knee  to  locate  a  radial  position 
that  wotdd  fall  into  a  region  of  high 
shear  stress  and  minimal  rouleaux 
formation.  They  also  studied  how 
well  the  method  normalized  frac¬ 
tional  moving  blood  volume  esti¬ 
mates  of  the  right  renal  cortex  in  a 
volunteer  when  simulating  different 
body  habitus  and  in  a  group  of  six 
healthy  volunteers  to  estimate  vari¬ 
ability. 

RESULTS:  Over  five  flow  velocities 
and  over  undersaturated  to  severely 
oversaturated  receiver  gains,  the  ad- 
culated  flow-tube  area  was  a  mean 
89%  ±  7  (±  standard  deviation)  of  a 
standard.  In  humans,  the  technique 
normalized  the  fractional  moving 
blood  volume  estimates  over  an  8-dB 
receiver  gain  variation;  the  mean  ± 
standard  deviation  of  fractional  mov¬ 
ing  blood  volmne  estimates  for  the 
six  volimteers  was  37.6%  ±  3.6. 

CONCLUSION:  Vascularity  esti¬ 
mates  with  power  Doppler  US  are 
feasible  with  a  normalization  scheme 
based  on  the  cumulative  Doppler 
power  distribution  function. 


Although  of  substantial  interest, 
ultrasound  (US)  Doppler  vascu¬ 
larity  measurements  have  been  used 
on  a  variable  basis  in  several  organ 
s)^tems  (1-4).  They  have  generally, 
but  not  exclusively,  been  based  on  the 
cotmting  of  color  pixels  in  standard 
color  Doppler  US  scans  and  have  been 
used  clinically  most  frequently  to  as¬ 
sess  tumor  vascularity  in  the  breast 
and  prostate  (5-13).  The  choice  of 
these  organs  is  mformative,  because  it 
reveals  one  of  the  greatest  shortcom¬ 
ings  of  US  vascularity  assessments: 
their  depth  dependence  In  all  of  the 
examples  in  which  quantitation  has 
been  used,  either  the  target  is  superfi¬ 
cial  or  the  transducer  has  been  posi¬ 
tioned  very  closely  to  the  area  of  inter¬ 
est.  This  is  because  vascularity  is 
assessed  by  counting  the  nuinber  of 
color  pixels  in  a  given  region,  and 
anythdng  that  alters  color  pixel  count 
will  affect  a  vascularity  assessment. 
Unfortunately,  the  density  of  blood 
vessels,  the  quantity  one  wishes  to 
measiue,  is  only  one  of  the  factors  that 
influences  the  color  pixel  count.  Major 
contributors  to  this  measurement  are 
attenuation,  aperture  size,  or  any 
other  property  that  alters  the  strength 
of  the  backscattered  echoes.  Given 
identical  tissue  samples,  their  vascu¬ 
larity  at  US  will  chmge  the  deeper  in 
the  body  they  are  located.  The  closer  a 
tissue  is  to  the  transducer,  the  more 
vascular  it  will  appear.  For  example, 
flow  in  ovaries  may  be  very  hard  to 


detect  transabdominally  and  yet  very 
easily  seen  transvaginally.  The  vascu¬ 
larity  detection  improvement  is  due 
primarily  to  a  reduced  attenuation 
path  in  tiie  latter,  which  3tields  some 
combination  of  higher  signal  and 
which  allows  the  use  of  higher  fre¬ 
quency  transducers  (14).  Because  of 
this  very  definite  attenuation  effect, 
vascularity  measurements  with  US 
are  tricky  to  make  and  interpret. 

A  potential  solution  to  this  problem 
does  exist.  If  one  can  identify  an  object 
of  known  vascularity  or  blood  vol¬ 
ume,  one  can  use  the  Doppler  power 
in  that  object  to  normalize  the  values 
in  the  surrotmding  tissue  (15-17).  If . 
the  tissues  of  interest  are  near  enou^ 
to  the  known  object,  the  fraction  of  the 
Doppler  power  in  the  surrounding 
tissue  relative  to  the  standard  can  be 
used  as  a  vascularity  estimate.  This 
process  effectively  compensates  for 
any  attenuation  or  transducer  beam 
profile  effects.  Because  blood  vessels 
contain  100%.blood,  objects  of  known 
vascularity  exist  throu^out  the  body 
and  could  be  used  to  normalize  vascu¬ 
larity  measurements.  We  will  call  such 
measurements  fractional  moving 
blood  volume  estimates  (17). 

There  is  one  problem,  however,  that 
has  to  be  overcome  before  this  method 
can  be  applied.  The  problem  arises 
because  the  backscattered  signal  from 
blood  is  variable  owing  mostly  to  the 
degree  of  rouleaux  formation  (18-22). 
The  reason  for  this  is  that  rouleaux 
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effectively  increases  tiie  size  of  the 
scattering  units  in  blood.  Qumps  of 
red  blood  cells  wiU  backscatter  more 
ultrasoimd  energy  than  wiU  indi¬ 
vidual  ceUs,  whidr  makes  areas  of 
vessels  with  more  rouleaux  have 
stronger  Doppler  signals  than  those 
wdth  less.  This  effect  is  most  pro¬ 
nounced  when  comparing  the  Dopp¬ 
ler  power  in  the  center  of  large  blood 
vessels  with  the  Doppler  power  in  the 
edges.  There  is  typic^y  much  more 
signal  amplitude  in  the  center  of  the 
vessels  owing  to  increased  rouleaux 
formation  (23).  The  higher  shear  rate 
and  shear  stress  near  die  vessel  wall 
apply  more  force  to  separate  rouleaux 
clumps  of  red  cells.  The  magnitude  of 
the  shear  rate,  which  is  dire^y  pro¬ 
portional  to  the  shear  stress,  depends 
on  the  velocity  profile  (24).  For  a  para¬ 
bolic  flow  profile,  the  shear  rate  and, 
thus,  the  shear  stress  are  directly  pro¬ 
portional  to  file  radius  (20).  Hence,  for 
a  1-cm-diameter  vessel,  the  shear  rate 
at  the  wall  will  be  10  times  that  0.5 
mm  from  tiie  center  of  the  vessel  For 
near  plug  flow,  the  shear  rate  at  the 
wall  can  be  arbitrarily  high.  Because 
of  this  variation  in  file  appearance  of 
blood  flow,  one  cannot  just  identify  a 
blood  vessd,  obtain  a  normalization 
value,  and  calculate  a  fractional  mov¬ 
ing  blood  volume  estimate  at  a  given 
depth.  A  more  sophisticated  technique 
is  required. 

It  is  known  that  smaller  vessels 
have  greater  shear  than  do  larger  ves¬ 
sels  for  a  given  mean  velocity  (25). 
Because  we  would  like  to  normalize 
vascularity  by  the  power  that  corre¬ 
sponds  to  100%  blood  in  tissue,  where 
Ae  blood  vessels  ate  small,  a  value 
outside  the  region,  of  high  rouleatuc 
would  be  appropnate.  Because  of  a 
condition  of  no  slippage  at  the  wall  or 
boundary,  there  is  no  flow  immedi¬ 
ately  adjacent  to  the  wall  of  a  vessel. 
Hence,  the  "correct"  normalizing 
value  lies  somewhere  between  the 
hig^  value  in  the  center  of  a  vessel 
and  the  zero  value  at  the  wall 
To  paiorm  a  fractional  moving 
blood  volume  estimate,  we  first  calcu¬ 
late  a  cumulative  Doppler  power  dis¬ 
tribution  function  over  the  region  of 
interest  (see  below).  We  then  identify 
the  knee  of  the  cumulative  Doppler 
power  distribution  function.  Th^  knee 
is  used  in  an  algorithm  to  define  a 
boundary  point  within  highly  vascu¬ 
lar  areas  in  which  we  will  search  for  a 
normalization  value.  The  knee  of  this 
distribution  is  a  reasonable  choice  for 
segmenting  a  population  into  two 
groups,  which  is  similar  to  what  is 
done  in  segmenting  populations  in 
receiver  operating  characteristic 


analysis  (26,27).  Once  the  normaliza¬ 
tion  value  is  measured,  we  use  that 
value  to  determine  the  fractional  mov¬ 
ing  blood  volume  estimate  in  tissue. 

We  performed  this  study  to  normal¬ 
ize  the  power  Doppler  US  signal  to 
the  expected  signal  from  100%  blood 
in  the  calculation  of  a  fractional  mov¬ 
ing  blood  volume  estimate.  We  used 
this  technique  to  compensate  for 
depth,  attenuation,  receiver  gain,  and 
machine  variability.  Ultimately,  we 
believe  that  the  results  strongly  sug¬ 
gest  that  this  technique  could  be  gen¬ 
erally  used  to  assess  vascularity  in 
tissues. 

MATERIALS  AND  METHODS 
Definition 

The  cumulative  Doppler  power  distribu¬ 
tion  function  is  the  integral  of  the  histo¬ 
gram  of  the  Doppler  poweiS  within  a  re¬ 
gion  of  interest  (28).  It  is  defined  in  a 
discrete  sense  as 

£-(F 

N(p)  =  2«(0, 

J-O 

where  n(i)  is  the  number  of  pixels  with  foe 
ifo  power  value  and  N(p)  is  foe  total  num¬ 
ber  of  pixels  wifo  power  values  less  than 
or  equal  top;  that  is,  z  sp.  Because  this  is 
an  integral  of  foe  hikogram,  foe  cumula¬ 
tive  Doppler  power  distribution  function 
has  some  nice  random  noise-suppressing 
properties  that  make  it  an  interesting  can¬ 
didate  for  finding  a  normalization  value. 

In  a  cumulative  distribution,  fluctuations 
are  referenced  to  foe  entire  display  range, 
whereas  with  a  standard  histogram,  being 
the  derivative  of  foe  cumulative  distribu¬ 
tion,  fluctuations  are  seen  relative  to  lo¬ 
cally  changing  values  for  which  any  varia¬ 
tion  is  a  much  larger  percentage. 

Phantom  Studies 

We  designed  a  flow-tube  experiment  to 
evaluate  foe  bozmdary-detection  proper¬ 
ties  of  foe  cumulative  Doppler  power  dis¬ 
tribution  function.  The  tube  consisted  of 
an  elongated  balloon  of  5.5  mm  in  diam¬ 
eter  in  a  fluid  bath.  The  balloon  was 
draped  across  a  sound-absorbing  pad  to 
suppress  reverberations.  Flow  in  foe  bal¬ 
loon  was  generated  by  using  a  pulsatile 
pump  (Harvard  Apparatizs,  South  Natick, 
Mass)  with  a  70%  duty  cycle  and  50 
strokes  per  minute.  Before  reaching  foe 
balloon,  foe  fluid  passed  through  a  long 
segment  of  compliant  gum  rubber  tubing 
tiiat  made  foe  flow  nonpulsatile.  Degassed 
water  that  contained  com  starch  particles 
(03  g  per  liter  of  water)  as  scatterers  was 
run  through  foe  balloon.  To  simulate  real 
flow-containing  tissue,  we  put  cross-linked 
dextran  beads  (Sephadex  particles;  Sigma 
Chemical,  St  Louis,  Mo;  20-80  pm  diam¬ 
eter  at  concentrations  of  0.0373^.2372 
g/L,  depending  on  foe  background  Dopp¬ 
ler  power  level)  into  the  bath  outside  foe 
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balloon.  By  stirring  foe  bath,  we  could  in¬ 
troduce  a  Doppler  shift  in  foe  medium 
and  generate  Doppler  power  in  foe  back¬ 
ground  similar  to  foe  ^ect  of  tissue  that 
contains  flowing  blood.  The  quantities  of 
cross-linked  dextran  beads  and  com  starch 
were  selected  so  that  the  tube  always  visu¬ 
ally  had  more  power  than  foe  water  bath 
at  each  flow  setting,  thus  simulating  a  ves¬ 
sel  siurounded  by  flowing  blood  within 
perfused  tissue.  We  made  three  measure¬ 
ments  at  each  flow  rate  investigated  (Table 
1).  These  three  measurements  were  made 
with  low  gam  to  simulate  a  weak  signal 
deep  in  tissue,  optimal  gain  (see  below) 
to  simulate  tissue  that  was  superficial 
enough  or  vascular  enough  to  supply  suf¬ 
ficient  signal,  and  high  gain  in  which  the 
signal  in  foe  fobe  was  saturated  to  simu¬ 
late  bad  technique  or  foe  presence  of  con¬ 
trast  agents. 

To  define  foe  gain  settings  for  foe  flow- 
tube  measurements  in  testing  foe  cumula¬ 
tive  Doppler  power  distribution  function 
algoritiun,  we  had  to  define  what  low 
gain,  optimal  gain,  and  high  gain  would 
be.  We  used  VST  US  scanners  (Diasonics, 
Santa  Qara,  (Zalif)  to  make  foe  measure¬ 
ments.  We  used  a  10-MHz  linear-array 
transducer  (Diasonics)  wifo  a  6.0-MHz 
Doppler  frequency.  The  angle  of  the  scan- 
head  to  the  ^e  was  22°  to  generate  a 
Doppler  angle.  We  measured  signal 
strength  and  saturation  level  by  assigning 
a  green-tag  value  to  Doppler  power  mea¬ 
surements.  Each  green-tag  step  defined  by 
foe  manufecturer  corresponded  to  0.4  dB. 
We  set  the  saturation  level  such  that  foe 
highest  green-tagged  pixels  in  foe  flow 
tube  were  within  three  click  steps  of  foe 
highest  decibel  level,  24  dB.  This  corre¬ 
sponded  to  having  foe  highest  pixel  values 
in  foe  flow  tube  be  no  more  thm  23R  dB 
on  foe  24-dB  scale,  which  represents  the 
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Figure  1.  Cross-sectional  US  image  of  com-starch-containing  flow  tube  (T)  in  a  water  bath 
(B)  that  contains  cross-linked  dextran  beads.  The  water  bath  was  manually  stirred  to  generate  a 
Doppler  signal,  represented  in  yellow,  and  simulated  viable,  blood-perfused  tissue.  The  tube, 
which  represents  a  blood  vessel,  corresponds  to  100%  blood  and,  hence,  has  more  Doppler 
power  than  the  water  bath,  which  simulates  less  vascular  tissue.  This  is  demonstrated  as  a  tube 
brighter  than  the  water  bath  in  power  mode.  The  outer  margin  of  the  blue  outline  of  the  flow 
tube  marks  the  boundary  of  the  tube,  as  calculated  by  using  the  automated  boimdary  detector. 
The  blue  line  is  actually  thicker  than  the  true  boundary  threshold  for  purposes  of  display.  The 
blue  pixels  equal  the  set  of  all  pixels  in  the  image,  such  that  threshold  £  pixel  value  £  thresh¬ 
old  +  0.9  dB.  Note  that  there  are  regions  in  the  water  bath  that  also  either  are  surrounded  by 
blue  or  are  blue.  These  correspond  to  potential  areas  of  100%  blood  in  tissue.  The  black  area 
behind  the  tube  and  water  bath  is  the  top  of  the  sound-absorbing  rubber  pad.  Also  note  that 
there  is  a  blue  ring  in  the  color  wheel  in  the  upper  left-hand  comer  (arrow).  The  area  of  the 
wheel  that  is  located  between  the  blue  ring  and  the  outer  edge  represents  the  portion  of  the 
entire  power  dynamic  range  that  is  assigned  to  100%  blood  in  this  particular  trial. 


Figure  2.  Cumulative  distribution  for  one  of 
the  phantom  flow  experiments.  The  plot  shows 
the  tinree  best-fit  lines  used  in  the  two-tangent 
technique.  The  global  best-fit  line  (solid  arrow) 
interse^  the  distribution  at  two  points.  A  tan¬ 
gent  line  is  defined  at  each  intersection  point, 
and  the  intersection  of  the  tangents  (open  arrow) 
defines  the  position  of  the  knee.  This  technique 
clearly  underestimates  the  position  of  the  knee. 
This  particular  plot  was  for  one  of  the  under¬ 
saturated  experiments,  which  is  why  it  does  not 
extend  to  24  dB. 


d)Tiamic  range  of  the  power-mode  signal. 
V^en  the  Doppler  gain  was  set  such  that 
the  pixels  wi^  the  highest  power  in  the 
image  fell  into  this  range,  the  settings  were 
considered  optimally  saturated.  We  then 
set  the  saturation  lirnit  in  a  range  that  was 
clearly  imdersaturated  (5-7  dB),  below  the 
optimally  saturated  setting,  and  finally  set 
a  range  in  which  the  Doppler  power  in  the 
tube  was  clearly  oversaturated  (5-7  dB 


above  optimal  saturation).  A  representa¬ 
tive  image  from  each  flow  run  was  stored 
digitally  to  the  hard  disk  on  the  scanner 
and  transferred  to  an  image  analysis  pro¬ 
gram  (a vs;  Advanced  Visual  Systems, 
Waltham,  Mass)  for  analysis. 

The  botmdary  of  100%  blood  as  seen 
with  the  ultrasound  beam  in  the  flow  tube 
was  identified  by  using  a  cumulative  dis¬ 
tribution  based  on  the  entire  data  set  and 
was  compared  to  an  observer-traced  pe¬ 
rimeter  of  the  tube,  which  was  considered 
the  standard  of  reference  (Fig  1).  To  define 
the  region  over  which  the  cumulative  dis¬ 
tribution  was  taken,  an  observer  first 
traced  the  entire  area  of  the  stored  image 
of  the  tube  and  the  water  bath,  with  the 
exclusion  of  the  sound-absorbing  rubber 
pad.  The  pad  was  excluded  because,  hav¬ 
ing  no  "flow,"  it  would  bias  the  measure¬ 
ment  by  introducing  a  structure  that  was 
much  different  from  the  paradigm  of  inter¬ 
est,  that  is,  blood  vessels  and  background 
tissue  with  flow.  A  cumulative  distribution 
was  calculated  on  the  basis  of  the  power 
values  within  this  enclosed  region.  The 
knee  or  point  of  maximum  curvature  of 
the  distribution  was  then  subjectively  se¬ 
lected  on  the  cumulative  distribution 
curve  for  each  flow  measurement.  We  used 
the  visual  estimate  of  the  knee  of  the  dis¬ 
tribution  for  this  calculation  because  it  was 
deemed  to  be  the  best  estimator  of  that 
point.  To  compensate  for  variability,  we 
selected  a  range  of  about  ±1  dB  about  the 
selected  threshold  and  calculated  the  areas 
within  these  limits.  Of  course,  this  method 
of  detecting  the  threshold  would  not  work 
in  practice;  therefore,  we  developed  tech¬ 


niques  for  automating  the  location  of  the 
knee  (see  below).  For  this  part  of  the  study, 
however,  it  was  thought  that  our  best  esti¬ 
mate  of  the  knee,  the  visual  estimate,  was 
the  most  appropriate  to  use. 

An  observer  then  traced  the  tube  as  a 
standard  of  reference  for  comparison  with 
the  cumulative  distribution-selected 
boimdary.  The  tube  was  traced  three  times 
at  each  flow  setting,  the  area  calculated 
with  each  traced  perimeter,  and  a  mean 
area  calculated  for  the  tube.  The  mean 
areas  for  the  cumulative  distribution- 
detected  region  and  for  the  manually 
traced  region  were  then  compared. 


Automated  Distribution 
Determination 

To  implement  a  fractional  blood  volume 
measurement  in  vivo  and  to  make  more 
objective  measurements,  we  wanted  to  use 
automation  to  calculate  the  position  of  the 
knee  of  the  distribution.  We  used  two  tech¬ 
niques,  each  of  which  was  initiated  in  the 
same  way.  A  best-fit  line  was  first  plotted 
through  the  distribution  by  using  a  stan¬ 
dard  least-squares  technique.  For  the  first 
technique,  the  points  of  intersection  of  the 
line  with  the  distribution  were  located, 
and  tangent  lines  parallel  to  the  cumula¬ 
tive  distribution  curve  were  drawn  at  the 
points  of  intersection.  The  intersection  of 
these  two  tangent  lines  defined  the  knee  of 
the  cumulative  distribution.  The  points  of 
intersection  were  determined  by  taking  the 
difference  between  the  cumulative  distri¬ 
bution  value  and  the  calculated  estimate, 
which  was  accomplished  by  using  the 
best-fit  line  for  each  successive  power 
value.  For  those  points  at  which  the  sign  of 
the  difference  changes,  there  must  be  an 
intersection  between  the  best-fit  line  and 
the  distribution  between  that  point  and  its 
neighbor,  either  one  of  which  could  be  de¬ 
fined  as  the  intersection  for  the  purposes 
defined  here.  The  tangent  fines  were  em¬ 
pirically  defined  over  21  point  regions,  the 
interse^on  point  ±  10  points  (Fig  2).  (Fur¬ 
ther  details  are  in  the  Appendix.) 

The  second  method  begins  as  the  first, 
with  fitting  of  the  cumulative  distribution 
with  a  best-fit  straight  line.  The  distribu¬ 
tion  is  then  rotated  about  the  best-fit  fine 
so  that  the  fine  falls  onto  the  abscissa.  On 
the  basis  of  the  shape  of  the  cumulative 
distribution,  this  fimction  should  have  a 
negative  curvature  and  there  should  there¬ 
fore  be  a  global  maximum.  A  global  maxi¬ 
mum  could  then  easily  be  identified  and 
corresponded  to  the  knee.  To  account  for 
noise  about  the  global  maximum,  a  region 
of  ±10  points  arormd  this  initially  identi¬ 
fied  global  maximiun  was  selected  and 
fitted  with  a  second-order  polynomial.  The 
power  value  that  corresponds  to  the  peak 
of  this  pol3momial  could  also  represent  the 
knee  of  the  distribution.  Although  not 
identical,  this  technique  is  similar  to  other 
methods  in  which  second-order  polynomi¬ 
als  are  used  to  search  for  maxima  (29). 

The  tangent  method  and  then  the  curve- 
fitting  method,  that  is,  the  initial  rotated 
peak  and  then  the  second-order  polynomi- 
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al-fitted  peak,  were  then  each  compared  to 
the  subjective  standard  of  reference  for 
finding  the  knees  of  the  cumulative  distri¬ 
butions  for  the  tube-flow  data  by  taking  a 
mean  absolute  difference  between  the 
measurements. 


Human  Studies 

The  human  studies  were  divided  into 
two  phases.  The  first  consisted  of  the  ac¬ 
quisition  of  multiple  scans  in  one  healthy 
volunteer  at  different  gain  settings  to 
simulate  different  body  habitus,  while  the 
second  consisted  of  the  acquisition  of  mul¬ 
tiple  scans  in  six  healthy  volunteers  to  in¬ 
vestigate  variability. 

In  the  first  phase,  the  right  kidney  of  a 
single  healthy  male  volunteer  (age,  49 
years;  weight,  76  kg;  height,  173  cm)  was 
scanned  on  five  different  occasions.  The 
studies  were  performed  by  using  a  3.5- 
MHz  curved  linear  scanhead  with  a  pulse 
repetition  frequency  of  1,000,  a  color 
Doppler  frequency  of  2.5  MHz,  and  an  en¬ 
semble  lengtit  of  10.  The  receiver  gain  was 
successively  increased  from  102  dB  to  112 
dB  in  2-dB  steps.  Over  this  range,  the  im¬ 
ages  clearly  progressed  from  highly  under¬ 
saturated  to  highly  oversaturated.  This 
manifested  as  a  lack  of  flow  detection  at 
the  102-dB  setting  and  as  a  very  bright  bal¬ 
looned  color  display  at  the  112-dB  setting. 
Again,  this  range  was  used  to  simulate 
scanning  a  deep  structure  without  the  use 
of  contrast  agents.  The  typical  optimal  set¬ 
ting  for  power  Doppler,  that  is,  when  the 
noise  floor  just  begins  to  break  through  the 
uniform  color  backgroimd  (29),  was  at 
about  105-107  dB  .  During  each  sampling, 
the  kidney  was  scarmed  longitudinally  at 
each  gain  setting  by  using  a  region  of  in¬ 
terest  defined  by  the  machine's  color  box 
that  included  as  much  of  the  near-field  cor¬ 
tex  of  the  kidney  as  possible  and  at  least 
half  of  the  renal  sinus.  Because  of  the  cur¬ 
vilinear  shape  of  the  color  box  imple¬ 
mented  with  this  probe,  some  liver  and 
perinephric  fat  were  also  included  in  the 
region  of  interest.  The  image  of  the  cortex 
chosen  for  analysis  at  any  given  scanning 
setting  was  the  one  that  subjectively  had 
the  most  visible  blood  flow.  The  first  cu¬ 
mulative  distribution  was  taken  over  the 
entire  color  box,  and  the  knee  of  the  distri¬ 
bution  was  automatically  calculated  with 
both  the  tangent  and  the  curve-fitting  tech¬ 
niques  described  above.  A  green  tag  was 
assigned  to  all  power  values  equal  to  or 
greater  than  the  value  identified  as  the 
knee  of  the  distribution.  The  technique 
that  helped  identify  a  knee  that  resifited  in 
assigning  the  greatest  fraction  of  the  color 
dynamic  range  to  potentially  100%  blood, 
that  is,  that  resulted  in  green  tagging  of  the 
most  pixels,  was  then  used  in  the  next 
stage  of  the  algorithm. 

A  second  cumulative  distribution  was 
then  taken  over  only  those  points  selected 
in  the  first  run.  The  knee  of  this  second 
distribution  was  then  identified  by  using 
the  two  techniques  described  above,  and 
the  value  that  assigned  the  largest  fraction 
of  the  dynamic  range  to  green  was  again 


used  as  the  normalization  value.  This 
value  became  the  normalization  value  for 
the  fractional  moving  blood  volume  esti¬ 
mation,  or,  equivalently,  the  lowest  Dopp¬ 
ler  power  that  corresponded  to  100% 
blood.  This  process  is  demonstrated  in 
Figure  3. 

A  region  of  cortex  in  which  the  frac¬ 
tional  moving  blood  volume  was  to  be  es¬ 
timated  was  then  traced  within  the  color 
box  by  using  the  machine's  tracker  ball. 
Other  than  file  selection  of  the  size  and 
location  of  the  color  box  itself,  this  was  the 
only  portion  of  the  examination  in  which 
there  was  operator  interaction.  A  fractional 
moving  blood  volume  estimate  was  calcu¬ 
lated  from  this  region.  The  means  and 
standard  deviations  of  the  selected  initial 
green-tag  level  were  plotted  as  a  function 
of  receiver  gain  to  show  the  effect  of  at¬ 
tenuation  and,  potentially,  body  habitus  on 
the  normalization  level.  Further,  a  mean 
value  and  a  standard  deviation  of  the  frac¬ 
tional  moving  blood  voliune  estimate  as  a 
function  of  receiver  gain  were  plotted  over 
the  five  measurements. 

The  second  phase  comprised  examina¬ 
tions  of  six  heathy  volunteers  (one  man, 
five  women;  mean  age  ±  standard  devia¬ 
tion,  34  years  ±  6  years;  age  range,  27-41 
years;  mean  weight,  78  kg  ±  22;  weight 
range,  57-116  kg;  mean  height,  173  cm  ± 

11;  height  range,  160-188  cm)  by  one  ex¬ 
aminer  (J.M.R.).  Each  volunteer  underwent 
scanning  on  3  different  days  without 
preparation,  for  purposes  of  practicality. 
The  volunteers  were  examined  by  using 
the  same  machines  described  above,  with 
optimization  of  the  setting  for  power 
Doppler  in  the  usual  manner,  &at  is,  the 
gain  was  increased  sequentially  until  the 
noise  floor  just  broke  through  file  uniform 
background  (30).  Once  the  receiver  gain 
was  set,  the  same  process  for  determining 
the  fractional  moving  blood  volume  esti¬ 
mate  in  the  single  volunteer  was  used.  The 
means  and  standard  deviations  for  the 
fractional  moving  blood  volume  estimates 
for  each  of  the  volimteers  were  plotted. 

RESULTS 

Flow  Experiment 

The  experimental  flow  runs  are 
given  in  Table  1.  The  area  of  the  tube 
detected  by  using  the  knee  of  the  cu¬ 
mulative  distribution  was  89%  ±  7  of 
the  subjective  boundary.  It  must  be 
said  that  at  the  highly  saturated  set¬ 
tings,  the  difference  between  the 
boxmdary  and  the  background  scatter- 
ers  in  the  medium  was  hard  to  see, 
and  the  knee  of  the  distribution  was 
often  thought  to  be  a  better  marker  of 
the  bormdary  than  the  standard  of 
reference.  Furthermore,  it  is  obvious 
that  there  was  blooming  of  the  flow 
tube  with  increasing  gain,  which 
made  the  detected  boundary  move 
outward.  This  corresponded  to  a 
larger  tube  area  for  any  given  velocity 
(Table  1)  and  is  to  be  expected  with 


higher  levels  of  saturation.  This  would 
manifest  in  vivo  as  enlargement  of  blood 
vessels  with  increasing  gain. 

We  then  compared  the  different 
knee-detecting  techniques  to  see  how 
well  they  identified  the  knee  com¬ 
pared  with  the  subjectively  chosen 
location  (Table  2).  It  is  clear  that  the 
tangent  method  underestimates  the 
subjectively  designated  position  of  the 
knee,  thereby  assigning  more  power 
values  to  100%  blood.  The  mean  abso¬ 
lute  difference  between  the  two  tan¬ 
gents  and  the  knee  was  0.91  dB.  The 
second-order  polynomial-fitting  tech¬ 
nique  more  closely  approximated  the 
subjectively  selected  Imee:  0.33  dB 
for  the  peak  value  and  0.30  dB  for  the 
second-order  polynomial-fitted  peak. 

Human  Studies 

The  segmentation  values  of  vascu¬ 
lar  structures  from  the  less  vascular 
background  were  plotted  as  a  function 
of  receiver  gain  (Fig  4).  The  plot  shows  a 
monotonic  decline  in  the  normalization 
level  as  a  fimction  of  receiver  gain. 

The  slope  is  significantly  different 
from  zero  (95%  confidence  interval: 
-0.996,  -(1.694).  This  result  is  what 
would  be  expected  if  the  knee  of  the 
cumulative  distribution  were  compen¬ 
sating  for  overlying  attenuation  and 
depth  of  the  organ,  that  is,  body  habi¬ 
tus.  The  weaker  the  flow  signal  in 
general,  the  greater  the  portion  of  the 
dynamic  range  that  may  be  assigned 
to  100%  blood.  Furthermore,  despite 
this  change  in  normalization  level 
with  gain,  the  ultimate  fractional 
moving  blood  volume  estimate  is 
largely  independent  of  receiver  gain 
(Fig  5).  This  is  based  on  taking  a  linear 
regression  and  determining  the  slope 
over  the  8-dB  highest  dynamic  range 
measurements,  104-112  dB,  which  is 
0.00624  (95%  confidence  interval: 
-0.00067, 0.01315).  Thus,  zero  is  in¬ 
cluded  in  the  95%  confidence  limits. 

The  addition  of  the  lowest  d5mamic 
range  measurement,  102  dB,  produces 
a  sigiuficant  positive  trend  in  the  data, 
with  a  slope  of  0.00798  (95%  confi¬ 
dence  interval:  0.00198, 0.01400).  Fi¬ 
nally,  scans  obtained  in  the  six  voltm- 
teers  show  the  means  ±  standard 
deviations  of  the  fractional  moving 
blood  volume  estimates  one  might 
expect  with  this  technique  (Fig  6).  The 
standard  deviation  for  any  single  indi¬ 
vidual  can  be  up  to  ±0.1.  This  corre¬ 
sponds  to  approximately  a  30%  variation 
relative  to  the  mean  value.  However,  the 
mean  of  the  means  ±  the  standard  de¬ 
viation  of  the  means  for  the  six  volun¬ 
teers'  fractional  moving  blood  volume 
estimates  is  37.6%  ±  3.6. 
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Figure  3.  (a)  Longitudinal  US  image  of  the  renal  cortex  with  near-field  hilar  vessels  in  a  49-year-old  volunteer.  The  brighter  the  orange,  the 
higher  the  Doppler  power.  Blue  represents  the  noise  floor  or  the  lowest  Doppler  power  displayed.  Notice  the  large  blue  area  in  the  near  field, 
which  corresponds  to  liver  (L).  (b)  Same  longitudinal  US  image  as  a  after  the  first  cumulative  distribution  has  been  taken  over  the  entire  color 
box  in  a.  The  green-tagged  pixels  correspond  to  those  that  coiild  represent  100%  blood  on  the  basis  of  the  knee  of  the  cumulative  distribution 
plot  for  the  region  of  interest,  shown  in  the  lower  left-hand  comer.  This  curve  is  typical  of  the  initial  in  vivo  distributions  in  this  study.  The  cal¬ 
culated  position  of  the  knee  is  marked  with  an  arrow.  All  pixels  with  power  values  equal  to  or  greater  than  the  knee  are  green.  (The  highlighted 
pixels  adjacent  to  the  green-tagged  regions  are  artifacts  of  photography  and  are  not  included  in  the  green-tagged  region.)  (c)  Same  longitudinal 
US  image  as  b  after  the  second  cumulative  distribution  has  been  taken  over  only  those  pixels  labeled  green  in  b.  A  second  group  of  pixels,  a  sub¬ 
set  of  those  in  b,  is  labeled  green  and  represents  the  final  pixels  determined  to  contain  100%  blood.  They  were  selected  on  the  basis  of  the  cumu¬ 
lative  distribution  plot,  shown  in  the  lower  left-hand  comer.  The  calculated  position  of  the  knee  (arrowhead)  corresponds  to  the  lowest  Doppler 
power  that  represents  100%  blood;  hence,  this  value  is  used  to  normalize  all  the  tissue  values  in  the  image.  Note  that  the  second  distribution 
demonstrates  a  much  truer  vascular  geometry  because  it  has  segmented  high-shear-rate  from  low-shear-rate  blood  flow  within  large  vessels. 
Small  vessels  in  tissue  will  not  show  up  owing  to  high  shear  and  partial  volume  averaging  with  tissue,  that  is,  a  fractional  moving  blood  volume 
estimate  of  less  than  100%.  (The  highlighted  pixels  adjacent  to  the  green-tagged  regions  are  artifacts  of  photography  and  are  not  included  in  the 
green-tagged  region.)  (d)  Same  longitudinal  US  image  as  c  with  the  region  of  the  cortex  to  be  measured  enclosed  by  the  dotted  line.  The  frac¬ 
tional  moving  blood  volume  estimate  was  calculated  over  that  entire  region  and  is  normalized  by  the  value  selected  in  c.  The  fractional  moving 
blood  volume  estimate  in  this  case  was  37.1%  (arrowhead).  (Again,  the  highlighted  pixels  adjacent  to  the  green-tagged  regions  are  artifacts  of 
photography  and  are  not  included  in  the  green-tagged  region.) 


DISCUSSION 

The  ultimate  aim  of  many  flow  im¬ 
aging  techniques  is  to  image  vascular¬ 
ity  or  perfusion,  and  US  is  no  excep¬ 
tion.  The  opportunity  for  US  to 
display  vascularity  has  never  been 


better.  With  contrast  agents  on  the  ho¬ 
rizon  and  power  Doppler,  it  is  now 
possible  for  US  to  directly  display  the 
amount  of  moving  blood  in  tissue, 
because,  unlike  standard  mean-fre¬ 
quency  color  Doppler,  the  power  in 
the  Doppler  signal  is  a  reflection  of 


the  vascular  blood  volume  of  the  tis¬ 
sue  sample  (20-22,31).  Furthermore, 
power  Doppler  has  the  potential  to 
overcome  a  major  limitation  of  US 
vascularity  measurements.  By  normal¬ 
izing  power  Doppler  signals  in  tissue 
against  a  blood  vessel  that  is  in  or 
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Table  2 


Comparison  of  Methods  for  Locating  the  Knee  Position  of  the  Ciunulative 
Distribution  for  the  Flow-Tube  Experiments 


Run 

Subjective 

Knee  Poation 
(dB) 

:  Knee  Position 

Two-Tangent 
Model  (dB) 

Rotated  Curve 
Peak  (dB) 

Second-Order 
^  Polynomial 

V  Fitted  Peak  (dB) 

1 

6.09 

4.69 

5.53 

5.44 

2  . 

9.09 

8.06 

8.72 

8.53 

3  ■ 

10.31 

9.19 

9.94 

-  '  9.94 

...■r-A 

5.16 

4.41 

5.44 

5.25 

5 

7.50 

6.38 

7.50  . 

7.13 

6 

9.09 

7.50 

-  9.19 

891 

7  ; 

6.47 

5.81  ■ 

6.19 

6.28 

8.72 

9.28  • 

9.47 

9.38 

9 

9.00 

7.78  ■  ' 

'8.91 

8.72 

10 

8.72 

8.34 

8.25 

8.16 

^  Tl 

7.78 

7.03 

8.34 

7.88 

12 

9.66 

928 

"9.47 

9.47 

13 

5.72 

5.16 

5.81 

5-.72  '. 

14 

675 

5.91 

6.94 

6.75 

15 

,  9.84 

8.63 

9.19 .  .. 

9.56 

Note. — The  sul^ecrtive  knee  position  is  the  standard  of  reference. 


near  a  region  being  evaluated,  it  is 
possible  to  compensate  for  the  dis¬ 
tance  between  the  transducer  and  the 
region  of  interest,  the  attenuation  co¬ 
efficient  of  the  overljdng  tissue,  and 
the  available  imaging  aperture, 
among  other  things  (32). 

The  problem  with  this  strategy  is 
that  the  amplitude  of  the  Doppler 
shift  signal  is  highly  dependent  on 
rouleaux  formation  (18-22),  which 
makes  it  impossible  to  merely  select 
any  point  within  a  large  vessel  for 
normalization.  However,  by  selecting 
a  normalization  value  from  the  region 
of  high  shear  near  the  vessel  wall,  the 
effects  of  rouleaux  can  presumably  be 
minimized.  This  aeates  a  situation 
that  approximates  that  in  small  ves¬ 
sels  in  tissue  where  the  shear  is  high 
and  rouleaux  is  low  (25). 

Hence,  a  normalization  technique 
must  allow  detection  of  blood  vessels 
and  identification  of  a  position  in  the 
vessels  to  use  for  normalizing.  The 
flow  phantom  study  shows  that  the 
cumulative  distribution  can  find 
blood  vessels.  In  fact,  it  can  optimally 
find  them  to  within  about  0.3  dB  rela¬ 
tive  to  the  observer.  In  the  clinical  por¬ 
tion  of  the  study,  we  typically  used 
the  tangent  estimate,  the  poorer  of  the 
two  estimating  techniques,  because  it 
tended  to  overestimate  the  number 
of  pixels  that  may  contain  100%  blood 
and  thus  increased  the  number  of 
points  included  in  the  distribution. 
However,  even  by  using  an  optimal 
technique  such  as  the  subjective 
method  in  the  flow  phantom,  regions 
still  are  selected  in  the  "hypovascu- 
lar"  tissue  bath  that  were  identified  as 
flow-containing  (Fig  1).  Findings  in 
the  right  kidneys  studied  were  similar. 
This  is  not  surprising  and  would  be 
expected,  at  least  in  the  first  distribu¬ 
tion,  given  the  presence  of  small  blood 
vessels  inside  tissue,  which  are  analo¬ 
gous  to  the  random  high  signals  in 
tine  water  bath. 

We  used  a  continuous-flow  phan¬ 
tom,  even  though  flow  in  vivo  can 
clearly  be  pulsatile.  We  decided  to  do 
this  because  power  Doppler  is  gener¬ 
ally  highly  frame  averaged  in  vivo. 

This  has  the  effect  of  averaging  out 
the  pulsatility  in  the  sampling.  Hence, 
the  nonpulsatile  phantom  would  in 
some  sense  be  an  estimate  of  what 
happens  in  this  first  approximation. 

Yet,  pulsatility  will  change  the  veloc¬ 
ity  distribution  in  a  vessel,  which  will 
change  the  power  distribution  on  the 
basis  of  the  shear  rate  effects,  as  de¬ 
scribed  above.  This  may  require  fur¬ 
ther  study. 

After  determining  the  knee  of  the 
first  distribution,  we  used  a  second 


distribution  to  find  the  normalization 
value  in  vivo.  The  reason  for  this  is 
that,  as  in  the  flow  phantom,  the  first 
distribution  essentially  located  the 
waU  or  the  neighborhood  just  outside 
of  the  walls  of  blood  vessels  that 
would  be  used  for  normalization.  We 
needed  to  find  a  value  inside  the  ves¬ 
sels  to  use  as  a  standard  in  normaliza¬ 
tion.  Thus,  the  second  distribution 
over  only  the  vessels  accomplished 
this. 

If  we  had  not  included  a  second 
distribution,  we  would  have  had  the 
problem  of  distinguishing  an  organ  of 
normal  vascularity  that  is  located 
deep  in  the  body  from  a  superficial 
organ  with  low  vascularity.  The  rea¬ 
son  for  this  is  that  the  first  distribution 
only  basically  locates  the  walls  of 
large  vessels,  as  shown  above.  It  will 
find  the  walls  whether  an  organ  is 
deep  and  normal  or  superficial  and 
hypovascular.  Because  we  use  an  ap¬ 
proximation  of  the  knee  as  the  thresh¬ 
old  and  this  knee  is  defined  relative  to 
the  parenchymal,  hypovascular  tissue, 
dividing  this  threshold  into  the  tissue 
value  will  give  a  similar  ratio  in  both 
cases.  The  distinction  between  a  deep 
organ  and  a  superficial  one  does  not 
lie  in  the  vessel  boimdaries  but  is  in 
the  Doppler  power  of  the  blood.  For 
identical  vessels,  the  more  superficial, 
the  more  power  the  blood  will  have. 
This  requires  that  a  second  distribu¬ 
tion  be  taken  over  the  vessels  them¬ 
selves  to  actually  find  a  normalization 
value  representative  of  the  blood  in 
the  vessels.  This  value  is  a  function  of 
the  vessel  depth.  We  could  have  just 
identified  the  vessels  manually  or  by 


using  some  other  technique  and  per¬ 
formed  a  distribution  over  the  vessels 
only.  Then  we  would  have  needed 
only  one  distribution.  The  first  distri¬ 
bution  lets  us  automate  the  method. 

There  obviously  have  to  be  at  least 
two  points  of  negative  curvature  to 
find  two  knees  in  our  process,  and  it 
makes  sense  that  there  should  be  at 
least  two.  The  first  knee  separates  the 
hypovascular  parenchyma  from  the 
blood  vessels,  and  the  second  knee 
separates  the  high-rouleaux  central 
portions  of  blood  vessels  from  the 
high-shear  margins  of  the  vessels. 
There  will  always  be  more  points  in 
the  first  distribution,  because  it  in¬ 
cludes  the  vessels  and  the  hypovascu¬ 
lar  tissue,  and,  given  a  large  enough 
region  of  interest,  the  first  knee  wfil 
dominate  and  will  be  the  one  selected 
with  our  method.  Once  the  vessels 
have  been  segmented  out,  the  method 
detects  the  second  knee.  If  the  number 
of  points  included  in  this  second  dis¬ 
tribution  is  small,  it  may  limit  the  abil¬ 
ity  to  accurately  detect  a  knee  in  some 
circumstances.  We  did  not  encotmter 
this  problem  in  this  study;  however, 
this  may  require  a  change  in  strategy 
when  very  small  regions  are  being 
measured.  This  effect  can  be  seen  in 
Figure  3b  and  3c:  The  knee  is  weU 
defined  in  Figiue  3b  but  is  not  as  well 
defined,  although  present,  in  Figure  3c. 

It  is  clear  in  this  study  that  we  have 
not  determined  where  that  precise  site 
in  the  vessel  is  or  what  the  true  nor¬ 
malization  value  should  be.  However, 
we  have  done  the  next  best  thing;  that 
is,  we  have  identified  a  method  that 
compensates  for  the  rouleaux  and  at- 
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Figures  4r^.  (4)  Green-tag  threshold  for  the  first  cumulative  distribution  as  a  function  of  the  receiver  gain.  These  values  represent  the  thresh¬ 
old  for  those  pixels  that  may  contain  100%  blood.  Only  those  pixels  with  higher  power  values  than  the  threshold  will  be  considered  as  possibly 
containing  100%  blood  in  the  algorithm  used.  The  points  are  bounded  above  and  below  by  ±1  standard  deviation.  Notice  that  the  slope  is  nega¬ 
tive,  whidi  means  that  the  lower  the  gain,  which  corresponds  to  weak  signal  or  large  amounts  of  attenuation,  the  more  dynamic  the  range  that 
may  be  assigned  to  blood.  (5)  Fractional  moving  blood  volume  estimates  as  a  function  of  receiver  gain  in  the  single  volunteer.  The  points  repre¬ 
sent  means  ±  1  standard  deviation.  (6)  Fractional  moving  blood  volume  estimates  in  the  six  volimteers.  The  points  represent  means  ±  1  stan¬ 
dard  deviation. 


tenuation  problem  in  a  general  way. 
First,  we  have  shown  that  the  plot  of 
the  initial  normalization  value  with 
receiver  gain  showed  a  continuous 
compensation  for  different  amoimts  of 
signal  by  setting  the  normalization 
vdue  to  different  fractions  of  the  us¬ 
able  color  dynamic  range  (Fig  4).  This 
change  in  normalization  compensated 
for  the  varying  amounts  of  backscat- 
tered  signi  received  at  the  different 
receiver  gains,  which  corresponded  to 
increasing  amotmts  of  attenuation, 
increasing  depth,  decreasing  amovmts 
of  available  transducer  aperture,  or  a 
combination  of  these.  The  slope  of  the 
regression  line  through  the  data  de¬ 
fined  in  Figure  4  shows  a  clear  trend, 
with  a  95%  confidence  interval  that 
did  not  intersect  zero.  Thus,  there  was 
a  distinct  and  significant  decrease  in 
the  proportion  of  the  color  dynamic 
range  that  was  assigned  to  100% 
blood  as  the  signal  strengthened,  or, 
conversely,  the  weaker  the  signal,  the 
more  of  the  dynamic  range  that  was 
assigned  to  100%  blood. 

This  result  makes  sense  if  one  con¬ 
siders  that,  if  there  were  no  detectable 
flow,  flowing  blood  would  look  like 
ever3dhing  else,,  and  the  entire  dy¬ 
namic  range  would  look  as  if  it  con¬ 
tained  100%  blood.  The  same  problem 
would  also  occur  in  highly  oversatu¬ 
rated  images,  where  the  gain  is  so 
high  that  everjdhing,  including  noise, 
is  enhanced  to  look  like  blood.  This 
would  have  created  a  jump  at  the  high 
receiver  gain  end  of  the  curve  if  we 
had  gone  high  enough.  However,  at 
that  point,  ever3dhing  would  be  satu¬ 
rated  and  it  would  be  impossible  to 
distinguish  blood  vessels  from  less 
vascular  surrounding  tissue.  This  is 


unlikely  to  happen  in  practice  because 
the  user  would  immediately  recognize 
it  and  turn  the  gain  down,  as  occurs  in 
blooming  with  contrast  agents  (33,34). 
However,  the  differential  blooming 
effect  of  power  Doppler  is  an  advan¬ 
tage  here,  where,  unlike  in  mean  fire- 
quency  color  US,  the  display  increase 
corresponds  to  the  amount  of  signal 
present.  Hence,  vessels  will  still  look 
brighter  than  backgroimd  tissue,  even 
wi&  blooming  (33,34),  and  our  results 
suggest  that  as  long  as  tissue  can  be 
distingviished  from  large  blood  ves¬ 
sels,  the  fractional  moving  blood  vol- 
mne  estimate  method  could  work  in 
principle. 

Second,  once  depth  dependence  of 
the  transducer  beam  profile  and  at¬ 
tenuation  are  compensated  for,  the 
measurement  of  the  same  tissue  re¬ 
gion  should  be  identical  if  the  normal¬ 
ization  method  is  working.  Figure  5 
shows  this  to  largely  be  the  case.  The 
slope  of  the  regression  line  through 
the  data  that  describe  ihe  fractional 
moving  blood  voltune  estimates  for 
gain  settings  of  104-112  dB  was  not 
different  from  zero  to  within  95%  con¬ 
fidence  (35).  Hence,  when  there  was 
sufficient  signal  to  detect,  the  method 
compensated  for  the  attenuation  and 
transducer  effects,  as  one  would  hope. 
However,  when  the  data  included  the 
102-dB  values,  there  was  a  significant 
trend.  In  addition,  the  variability  in 
the  102-dB  measurement  was  higher 
than  that  in  any  of  the  others.  The  im¬ 
plication  here  is  that  when  there  is 
very  little  flow  to  detect,  the  method 
imdercompensates  and  results  be¬ 
come  more  variable.  This  suggests 
that  when  the  signal  is  weak  and  is 
harder  to  detect,  the  method  tends  to 


locate  a  normalization  value  within 
the  high-rouleaux  portion  of  the  flow 
stream  and  would,  in  a  sense,  over¬ 
compensate  for  the  lost  signal  in  the 
cortex,  where  the  rouleaux  effects  are 
small.  This  would  give  a  low  estimate 
because  the  method  would  be  com¬ 
paring  high-rouleaux  areas  in  vessels 
to  low-rouleaux  areas  in  tissue.  At 
some  attenuation  level,  the  Doppler 
signal  will  be  too  weak  to  measure, 
and  any  normalization  technique  will 
fail.  One  compensating  fact  is  that 
when  the  signal  gets  very  weak,  it  is 
still  possible  to  compare  the  measure¬ 
ment  to  itself  (17).  Hence,  the  normal¬ 
ization  firom  day  to  day  may  make  it 
possible  to  evaluate  relative  flow 
changes  in  the  same  organ,  even  if  the 
attenuation  is  high. 

Finally,  the  evaluation  of  the  volun¬ 
teers  without  preparation  estimated 
the  potential  variability  in  the  method 
imder  scanning  conditions.  Clearly, 
one  would  like  a  technique  with  little 
or  no  variability  at  all;  yet,  in  some 
cases  the  standard  deviation  in  the 
measurements  was  up  to  10%,  which 
produced  a  variability  relative  to  the 
local  mean  of  approximately  30% 
from  day  to  day,  even  when  the  signal 
was  optimized.  In  these  studies,  there 
was  no  control  for  hydration,  time  of 
day,  or  fasting;  all  of  which  could 
have  influenced  the  variability.  Fur¬ 
thermore,  given  the  single-volimteer 
studies,  where  the  variance  was 
smaller,  it  may  be  reasonable  to  pre¬ 
sume  that  the  variability  is  the  true 
variation  in  the  blood  flow  to  the  renal 
cortex.  It  is  clear  to  anyone  who  does 
US  that  there  are  regions  of  the  cortex 
with  more  flow  than  others;  so,  when 
performing  scanning  in  the  same  per- 
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son  on  different  days  it  is  possible  to 
obtain  different  results. 

Will  such  variability  preclude  using 
this  test?  We  do  not  think  so.  First,  the 
mean  values  are  very  close  among  aU 
the  individuals,  which  suggests  that  a 
mean  value  may  be  usable  in  any 
given  case.  Thus,  taking  the  mean  of 
several  measurements  may  give  very 
reasonable  results.  This  is  exactly 
what  is  done  presently  with  all  resis¬ 
tive  index  measurements.  Second, 
there  can  be  equally  wide  variability 
among  results  of  odrer  parametric 
tests,  such  as  resistive  indices,  pulsa- 
tility  indices,  acceleration,  and  accel¬ 
eration  times  (36-38).  Each  of  these 
has  formd  use  in  the  medical  commu¬ 
nity.  Finally,  there  are  ways  to  im¬ 
prove  the  collection  on  the  horizon, 
that  is,  three-dimensional  imaging 
(16).  This  method  would  be  perfectly 
integrated  into  a  three-dimensional 
acquisition  system.  The  segmentation 
would  be  used  in  the  same  way,  but 
the  sampling  would  be  more  robust. 
Given  the  large  set  of  flows  that 
would  be  sampled  in  the  cortex  in 
three  dimensions,  the  flow  variation 
in  an  organ  would  likely  decrease. 

Besides  the  limitations  described 
above,  there  are  others.  As  mentioned 
above,  we  have  not  defined  the  abso¬ 
lute  fractional  blood  volume  in  the 
kidney.  Although  the  mean  values 
obtained  are  within  or  close  to  the 
published  normal  levels  in  the  kidney 
(39-41),  we  do  not  know  if  those  num¬ 
bers  measured  here  are  in  fact  abso¬ 
lute  fractional  blood  volume  esti¬ 
mates.  This  may  be  true,  but  it  will 
likely  have  little  effect  on  the  clinical 
application  of  such  a  measure  as  this. 
There  are  plenty  of  "indices"  that  re¬ 
late  to  physiologic  parameters  of  in¬ 
terest  but  may  not  directly  measure 
them,  such  as  the  resistive  index  (42,43). 
Also,  there  are  clearly  flows  that  will 
not  be  included  in  this  measurement. 
Capillary  flow,  for  instance,  is  too 
slow  to  measure  by  using  present 
Doppler  techniques.  Thus,  these  ves¬ 
sels  wiU  not  be  included  in  any  vas¬ 
cularity  estimate  derived  with  our 
method.  Of  course,  capillaries  will  not 
contribute  to  any  US  color  Doppler 
vascularity  measure,  in  neither  mean- 
frequency  color-flow  nor  power  mode. 

In  addition,  vascularity  assessments 
by  using  color  Doppler  techniques 
cannot  be  easily  normalized,  unlike 
ours.  Flence,  we  believe  that  our 
method  should  surpass  these. 

In  conclusion,  we  have  defined  a 
method  for  normalizing  the  power 
Doppler  fractional  moving  blood  vol¬ 
ume  estimate  by  using  properties  of 
the  cumulative  Doppler  power  distri¬ 


bution.  The  technique  is  almost  com¬ 
pletely  nonsubjective  and  could  easily 
be  automated.  The  method  works  in 
phantom  studies  to  find  blood  vessel 
boundaries,  can  be  normalized  for 
depth,  gives  constant  measurements 
for  the  same  flow  situation  largely 
independently  of  body  habitus,  and 
gives  reasonable  mean  fractional  mov¬ 
ing  blood  volume  estimates  in  healthy 
volimteers  with  a  variability  similar  to 
that  of  other  functional  parametric 
indices.  Further  studies  in  pathologic 
cases  are  needed  to  define  its  useful¬ 
ness. 

APPENDIX 

Quantitatively,  the  definition  of  the  in¬ 
tersection  points  and  tangent  lines  looks 
like  this:  P'{x)  =  Ax  +  B,  which  is  the  form 
of  the  best-fit  line  for  a  given  distribution, 
where  P'(x)  is  the  estimated  cumulative 
value  for  a  given  x,  the  Doppler  power, 
and  A  and  B  are  constants.  If  P{x)  is  the 
true  distribution  of  the  data,  then  P(x)  — 
P'(x)  will  be  zero  at  the  points  of  intersec¬ 
tion  of  the  tme  distribution  and  the  best-fit 
tine.  Because  this  is  real  data,  we  cannot 
rely  on  the  actual  points  of  intersection 
being  in  the  data  set.  Hence,  one  can  iden¬ 
tify  tire  point  in  the  data  set  closest  to  the 
intersection  as  being  the  one  where  there  is 
a  sign  change.  For  example,  an  intersection 
would  lie  immediately  between  points  x, 
and  Xi  +  1  if  F(x,)  -  P'(Xi)  <  0  and  F(Xj+  1) 

-  F'(x;+  1)  >  0.  As  a  first  approximation, 
one  could  choose  either  x,  or  Xf-t  1  as  the 
intersection.  Because  we  are  interested 
only  in  a  set  of  points  centered  at  either  X; 
or  X;+  1  to  define  a  tangent,  it  does  not  re¬ 
ally  matter  which  point  we  pick.  Choosing 
either  one  of  these  points  at  each  intersec¬ 
tion,  we  empirically  selected  a  21-point 
region  of  interest  centered  about  each  se¬ 
lected  point,  for  example,  Xj  ±  10  points, 
and  fitted  a  line  through  each  group  of  21 
points.  We  selected  a  21-point  region  be¬ 
cause  that  worked  well  empirically.  This 
local,  fitted  line  is  the  local  tangent. 

The  final  complication  is  that  it  is  pos¬ 
sible  that  there  could  be  more  than  two 
intersections  of  the  global  best-fit  line  with 
the  distribution.  To  get  around  this  possi¬ 
bility,  we  progressively  identified  each 
point  of  intersection  of  the  best-fit  fine 
with  the  cumulative  distribution  by  mov¬ 
ing  from  the  origin  toward  increasing  ab¬ 
scissa  values,  that  is,  Doppler  power.  We 
then  selected  the  first  pair  of  tangent  lines 
in  which  the  difference  between  their 
slopes  was  negative,  that  is,  in  which  their 
slopes  were  decreasing  or  the  curvature 
was  negative.  For  example,  if  T  is  a  tan¬ 
gent  line  and  i  is  a  set  of  abscissa  values  of 
intersection  points  that  range  sequentially 
from  1  to  n,  then  T(i)  is  the  line  tangent  to 
the  cumulative  distribution  at  i.  If  slope 
T(i)  is  the  slope  of  tangent  line  T{i)  and  if 
Tfi)  and  T{i  +  1)  are  the  first  pair  of  tangent 
lines  encountered  when  moving  toward  the 
right  finm  the  origin  whose  difference  in 
slopes  is  negative  (slope  T{i  +  1)  —  slope 


T(i)  <  0),  then  the  intersection  of  T{i)  and 

T(i  +  1)  is  the  chosen  point  for  the 

knee.  ■ 
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Abstract — In  this  article,  new  measures  obtained  from  color  Doppler  images  are  introduced  and  a  pilot 
study  is  described,  in  which  these  and  previously  published  indices  are  evaluated  for  use  in  future  work. 
Twenty  women  with  breast  masses  observed  on  mammography  and  going  to  surgical  biopsy  were  studied. 
Of  the  masses,  11  proved  to  be  benign  and  9  were  malignant.  Both  3-D  mean  frequency  shift  (f-CDI)  and 
power  mode  Doppler  (p-CDI)  imaging  were  performed.  To  identify  the  mass  and  other  regions  of  interest, 
vessels  were  displayed  as  rotatable  3-D  color  volumes,  superimposed  on  selectable  grey-scale/color  flow 
slices.  Doppler  signals  were  recorded  in  each  of  6  ellipsoidal  regions  of  interest  in  and  around  the  mass  and 
2  in  normal  tissues.  Seven  measures  were  computed  in  each  region,  three  from  power  mode,  two  from  mean 
frequency  and  two  from  combinations  of  both.  Radiologists  rated  the  grey-scale  appearances  of  the  masses 
on  a  scale  of  1  to  5  (5  =  most  suspicious)  for  each  of  6  conventional  grey-scale  criteria.  Of  the  individual 
vascularity  measures  in  individual  ROIs,  the  log  speed-weighted  pixel  density  and  log  power-weighted  pixel 
density  in  the  lesion  internal  periphery  showed  the  greatest  discrimination  of  malignancy,  although  neither 
was  statistically  significant  nor  as  good  as  the  peak  variables  described  below.  The  mean  visual  grey-scale 
rating  was  the  best  discriminator  overall,  but  two  peak  vascularity  measures  each  made  promising 
scatterplots  in  conjunction  with  the  average  visual  grey-scale  rating.  These  two  vascularity  measures  were 
the  log  peak  normalized  power-weighted  pixel  density  (peak  NPD)  and  log  of  peak  mean  Doppler  frequency 
times  the  peak  NPD  (v^,  •  NPDjyj).  Each  of  these  two  values  was  the  maximum  in  any  one  of  the  five  chosen 
ROIs  closely  associated  with  the  mass.  A  possible  rationale  for  the  relative  success  of  these  peak  values  is 
the  blood  signal’s  normalization  and  the  inhomogeneity  of  most  breast  cancers  and  the  expectation  that  the 
highest  velocities  (shunting)  and  largest  collections  of  blood  are  not  necessarily  in  the  same  region  in  and 
around  the  tumor.  Peak  NPD  of  cancers  varied  with  age,  decreasing  by  a  factor  of  45  from  33  to  77  y. 
©  1998  World  Federation  for  Ultrasound  in  Medicine  &  Biology. 

Key  Words:  Blood,  Angiogenesis,  Blood  volume.  Perfusion,  Ultrasound,  Doppler,  Image  processing.  Three- 
dimensional  imaging.  Breast  cancer.  Diagnostic  imaging. 


INTRODUCTION 

Visual  assessment  of  color  Doppler  imaging,  both  power 
mode  (p-CDI)  and  frequency  shift  (f-CDI),  may  be  aided 
by  quantitative  analysis  of  information  provided  in  the 
images.  Several  quantitative  and  semiquantitative  studies 
have  been  performed  recently  {e.g.,  Cosgrove  et  al.  1993; 
Huber  et  al.  1994;  Kedar  et  al.  1994;  Carson  et  al.  1995; 
Meyerowitz  et  al.  1996)  and  others  summarized  by  Mey- 
erowitz  et  al.  (1996).  Typically,  these  studies  used  mean 
frequency  f-CDI  from  which  values  of  the  mean  color 
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pixel  value  and  fraction  of  color  pixels  were  calculated. 
Using  the  mean  color  pixel  value,  Huber  et  al.  (1994) 
achieved  a  much  higher  sensitivity  and  specificity  for 
differentiation  of  carcinomas  from  benign  lesions  than 
they  did  with  visual  analysis.  Meyerowitz  et  al.  (1996) 
quantified  information  on  murine  lung  tumors  in  the 
power  mode  color  Doppler  imaging  (p-CDI).  One  of  the 
indices  they  measured  in  regions  of  interest  (ROIs)  was 
the  mean  power  of  color  pixels.  Their  other  two  indices 
and  terminology,  color  pixel  density  and  power- weighted 
pixel  density,  were  the  same  as  two  of  those  we  have 
been  investigating  (Carson  et  al.  1995). 

To  standardize  breast  lesion  vascularity  measures 
further,  to  evaluate  information  provided  in  the  new 
power  mode  color  flow  images,  and  to  aid  visual  analy- 
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sis,  we  undertook  a  visual  and  digital  analysis  of  infor¬ 
mation  in  a  study  including  3-D  ultrasound  examinations 
of  20  patients  scheduled  for  breast  biopsy  (Carson  et  al. 
1997).  Studies  of  these  biopsy-proven  20  cases  (4  fibro¬ 
adenomas,  7  other  benign  masses  and  9  cancer  cases) 
were  reviewed  by  radiologists  for  this  qualitative  analy¬ 
sis,  using  six  visual  criteria  of  grey-scale  characteristics 
(described  in  Methods)  and  8  visual  criteria  of  power 
mode  Doppler  characteristics.  3-D  vascular/pulse-echo 
display  provided  a  much  stronger  subjective  appreciation 
of  vascular  morphology  and  allowed  a  somewhat  better 
ultrasound  discrimination  of  malignant  masses  than  did 
the  corresponding  2-D  images  or  videotapes  (specifici¬ 
ties  of  85%,  79%  and  71%,  respectively,  at  a  sensitivity 
of  90%).  Only  in  the  3-D  display  did  the  vascularity 
measures  display  a  trend  towards  significance  in  this 
small  study.  The  combined  pulse-echo  rating  was  the 
best  discriminator  of  cancer  for  all  three  display  meth¬ 
ods.  That  same  visual,  3-D  pulse-echo  analysis  is  em¬ 
ployed  in  this  present  report  for  comparison  with  the 
digital  vascularity  assessment.  Much  of  the  background 
of  this  study  was  discussed  in  the  visual  analysis  paper 
(Carson  et  al.  1997). 

MATERIALS  AND  METHODS 

General  methods 

Data  were  collected  from  39  subjects  in  44  exami¬ 
nations  in  this  preliminary  study.  Subjects  were  selected 
after  the  decision  to  biopsy  based  on  identification  of  a 
mass  in  mammography,  clinical  examinations  or  simple 
grey-scale  ultrasound.  The  quantitative  measures  were 
calculated  for  only  20  different  subjects,  due  to  the 
quality  in  some  studies  and  inconsistent  system  settings 
in  the  earlier  studies.  Masses  of  very  low  suspicion  (e.g., 
most  fibroadenomas)  were  not  included.  Of  the  masses,  9 
were  malignant,  4  were  fibroadenomas,  and  7  were  other 
benign  masses. 

Each  examination  consisted  of  one  or  more  power 
mode  3-D  scans  and  a  frequency  shift  3-D  scan  of  the 
mass  and  the  surrounding  tissue.  (The  power  mode  scan 
analyzed  was  the  one  in  which  the  lesion  was  best 
centered  or  there  were  the  fewest  artifacts.)  The  3-D 
scans  were  acquired  using  the  system  described  in 
Moskalik  et  al.  (1995).  This  system  consisted  of  a  con¬ 
ventional  ultrasound  scanner  (Spectra  VST,  Diasonics, 
Inc.,  Milpitas,  CA),  a  modified  mammography  unit  that 
applied  mild  compression  to  stabilize  the  breast  and  a 
motorized  transducer  positioner  mounted  to  the  mam¬ 
mography  unit.  A  typical  scan  through  an  acoustically 
transparent  window  produced  a  3-D  volume  of  ultra¬ 
sound  data  of  the  suspicious  region  of  the  breast  from  a 
series  of  approximately  coronal  2-D  images  separated 
typically  by  a  distance  of  approximately  3/f  (mm),  where 


f  is  the  Doppler  imaging  frequency^  in  MHz.  At  the 
6-MHz  Doppler  frequency  of  our  6-10  MHz  linear  ar¬ 
ray,  the  step  size  was  0.5  mm.  Data  from  the  50-120 
images  per  scan  were  then  transferred  to  a  workstation. 
With  the  linear  array  scanhead  employed  for  this  study, 
the  images  were  typically  38  mm  by  40  or  50  mm. 
Power-mode  Doppler  ultrasound  was  performed  at  a 
PRF  of  700  Hz,  an  ensemble  length  of  14,  and  the 
minimum  sample  length  and  maximum  gain  not  produc¬ 
ing  frequent  color  noise.  The  same  was  done  in  color- 
flow  mode  but  with  a  higher  PRF  of  1000  Hz.  At  this 
setting,  there  was  some  aliasing,  which  decreased  the 
recorded  mean  velocity  in  some  ROIs  of  some  subjects. 
RGB  video  image  signals  from  the  ultrasound  system 
were  digitized  with  a  frame  grabber  (Targa  64).  Using 
the  manufacturer-supplied  color  maps,  log-compressed, 
RGB  p-CDI  image  signals  were  converted  from  color 
and  decompressed  to  linear  values  proportional  to  the 
Doppler  signal  power.  This  conversion  was  tested  by 
comparing  the  decompressed  signals  with  relative  back- 
scatter  as  determined  by  concentrations  of  small  polysty¬ 
rene  particles  in  water  (Rubin  et  al.  1995).  Similarly, 
f-CDI  RGB  signals  were  digitized  and  converted  to  the 
linear  mean  speeds  in  each  pixel,  as  described  below. 
Mean  velocity  in  a  pixel  was  calibrated  with  a  flow  tube 
phantom  at  a  measured  Doppler  angle. 

The  six  visual  grey-scale  criteria  were  defined  with 
scales  from  1  to  5,  5  being  those  characterized  as  the 
most  malignant.  Defined  in  more  detail  in  Carson  et  al. 
(1997),  they  were  smoothness,  shape,  and  visibility  of 
the  margins  plus  echogenicity,  orientation  and  attenua¬ 
tion  of  the  mass.  For  echogenicity,  a  rating  of  1  corre¬ 
sponded  to  anechoic  (cystic).  With  solid  masses,  the 
order  was  reversed,  to  keep  5  as  the  most  malignant 
rating.  A  rating  of  2  was  most  echogenic  and  5  was 
hypoechoic  (but  not  fully  cystic). 

Quantitative  measures 

The  Doppler  signal  power  imaging  mode  (Rubin 
and  Adler  1993;  Rubin  et  al.  1994)  and  frequency- shift 
imaging  mode  provide  the  data  necessary  to  quantify  the 
Doppler  image  signal  characteristics  listed  below.  These 
are  not  absolute  measures  of  tumor  flow  characteristics 
because  they  are  dependent  on  a  number  of  uncontrolled 
factors,  discussed  below.  The  relation  of  these  quantities 
to  fractional  blood  volumes  and  perfusion  are  also  dis¬ 
cussed  more  extensively  elsewhere  (Carson  et  al.  1993; 
Rubin  et  al.  1994,  1995,  1997).  These  quantities  were 
developed  to  aid  in  the  objective  assessment  of  the  role 
of  Doppler  vascularity  imaging  for  a  more  definitive 
diagnosis  of  suspected  carcinoma. 


The  step  size  should,  ideally,  be  approximately  half  the  eleva- 
tional  6-dB  beam  width. 
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Table  1.  Summary  of  studied  measures  from  the  power  mode  and  frequency  shift  modes  of  the  color  flow 

doppler  images. 


Abbreviation 

Full  name 

Formula 

PD 

Power-weighted  pixei  density 

Nb 

PD='2,P/N, 

NMPCP 

Normalized  mean  power  in  colored  pixels 

p  / 

NMPCP  =^yjNt 

NPD 

Normalized  power-weighted  pixel  density 

p  , 

NPD^^y  N, 

,=i 

SWD 

Speed-weighted  pixel  density 

Nb 

SWD  =  ^  Vi/N, 

1  =  1 

V 

Mean  speed  in  colored  pixels 

Nb 

SNPD 

Speed  and  power- weighted  normalized  pixel  density 

SNPD=^—  N, 

Vm  •  fJPDM 

Peak  mean  speed  times  peak  NPD 

i  1 

Vu  •  NPDm  =  max(v)  ■  max  (NPD) 

As  can  be  seen,  the  first  three  measures  in  Table  1  are  obtained  only  from  the  power-mode  images.  The  fourth  and  fifth  are  from 
the  frequency-shift  color  flow  images  and  the  last  two  utilize  data  from  both  modes.  Symbols  are  defined  in  the  text. 


Quantities  in  Table  1  were  calculated  in  each  of  the 
eight  regions  of  interest  (ROIs)  defined  in  Table  2,  where 
the  borders  of  the  masses  were  taken  from  the  pulse  echo 
image  and  palpation.  is  the  number  of  pixels  with 
flow  in  them  and  Nt  is  the  total  number  of  pixels  in  the 
region  of  interest.  Pj  is  the  power  Doppler  value  of  the  ith 
pixel  and  V;  is  the  Doppler  speed  from  the  absolute  value 
of  the  mean  frequency  shift  in  the  ith  pixel,  assuming  the 
cosine  of  the  Doppler  angle  =  0.5.  This  would  give  the 
correct  speed  averaged  over  many  pixels  for  an  isotropic 
distribution  of  vessels.  This  isotropic  assumption  is  nec¬ 
essary  because  no  vessel  angle  information  is  recorded  at 
this  time.  To  represent  100%  blood  for  normalization  of 
the  blood  signals,  is  the  average  Doppler  power  value 
measured  in  a  large  vessel.  NPDj  refers  to  a  single  region 
i  and  NPDj,^  refers  to  the  peak  of  NPDjS  among  a  defined 
set  of  regions.  For  v^.!  •  NPDj^,  the  maximum  of  v  over 


any  region  and  maximum  value  of  NPD  over  any  region 
were  taken  for  defined  sets  of  regions.  The  four  normal¬ 
ized  measures  were  introduced  in  Carson  et  al.  (1993). 

There  is  a  problem  of  measuring  v  without  aliasing 
effects  when  it  is  desired  to  see  as  much  of  the  vascular 
tree  as  possible  in  f-CDI  mode  (as  is  done  in  p-CDI 
mode).  One  could  scan  at  higher  PRFs  to  avoid  aliasing, 
but  then  the  number  of  vessels  seen  without  contrast 
agents  and  the  diversity  of  their  orientations  might  be  too 
small  for  the  unknown  Doppler  angles  to  average  out.  An 
intermediate  PRF  was  employed. 

The  problem  with  absolute  measures  from  most 
unnormalized  power  mode  signal  indices,  such  as  power- 
weighted  pixel  density  (PD)  and  color  pixel  density  in 
either  mode,  f-CDI  or  p-CDI,  is  that  the  absolute  mea¬ 
sures  increase  with  system  gain  and  output  and  decrease 
with  depth  in  the  tissues  due  to  attenuation  and  the  lack 


Table  2.  List  of  the  eight  ROIs  used  in  the  quantitative  analysis  of  the  3-D  data. 


1.  Lesion  periphery;  normally  from  the  outer  grey-scale  border  to  1  cm  inside 

2.  Lesion  periphery,  proximal  side  only  (hemiellipsoidal  version  of  region) 

3.  Central  core  of  those  lesions  that  are  >2  cm  in  diameter 

4.  Extemai  periphery — mass  grey-scale  boundary  to  1  cm  outside 

5.  Extemai  periphery,  proximal  side  only  (hemiellipsoidal  version  of  Region  4) 

6.  Abnormal  region  of  highest  vascularity  (>1.5  cm  diameter  and  >1  cm  from  mass,  but  associated  with  it) 

7.  Normal  fatty  tissue  volume 

8.  Normal  fibroglandular  ROI 


The  measures  listed  in  Table  1  are  calculated  from  each  region.  Regions  1-6  are  associated  with  the  mass.  The  other 
Regions,  7  and  8,  did  not  show  eariy  promise  and  were  not  analyzed  extensively. 
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of  sufficient  signal  level  in  color  Doppler  imaging  to 
effectively  utilize  TGC  over  much  of  the  field  of  view. 
Some  preset  TGC  is  used  in  power  mode.  The  power 
measures  that  are  normalized  to  the  power  signal  from 
the  largest  vessel  at  a  representative  depth  range  also 
probably  can  fluctuate  strongly  in  some  cases.  This  study 
begins  the  assessment  of  whether  or  not  the  normaliza¬ 
tion  will  improve  stability  of  the  vascular  measures. 
What  is  needed  for  the  normalization  to  work  well  is  that 
the  normalizing  vessel  be  larger  than  the  color  Doppler 
sample  volumes  and  be  at  the  right  depth  or  depths.  In 
this  study,  the  normalization  was  usually  based  on  a 
single  measurement  at  a  single  depth  closest  to  the  region 
of  interest.  Work  is  progressing  on  efforts  to  define 
signals  from  100%  blood,  based  on  all  the  larger  vessels 
in  each  given  depth  range  (Rubin  et  al.  1997),  and  to 
eliminate  signals  from  low-shear  portions  of  vessels 
where  abnormally  high  Doppler  signals  are  produced  by 
rouleaux  formation. 

3-D  displays  were  illustrated  in  the  visual  analysis 
report  (Carson  et  al.  1997).  The  data  were  used  to  form 
3-D  isosurface  renderings  of  the  vasculature  that  could 
be  rotated  and  shown  in  correct  positional  relationship  to 
grey-scale  slices  of  the  3-D  image.  An  example  of  the 
employed  display  on  a  nonpalpable,  7-mm  intraductal 
carcinoma  is  illustrated  more  fully  on  our  Web  page: 
http://www.med.umich.edu/ultrasound/anim/develop/ 
Case38.html. 

A  typical  example  of  a  3-D  color  flow  image  dis¬ 
play  without  vascular  isosurface  delineation  is  shown  in 
Fig.  la-d.  The  grey-scale  borders  of  this  infiltrating 
ductal  carcinoma  are  demarcated  by  a  translucent  ellip¬ 
soid  representing  Region  1  (defined  in  Table  2)  for 
quantitative  analysis.  Software  was  developed  in  AVS-5 
(Advanced  Visualization  System,  Waltham,  MA)  to  se¬ 
lect  an  ROI  from  the  3-D  images  as  an  ellipse  or  an 
ellipsoidal  annulus  whose  3  major  and  minor  axes  and 
center  coordinates  were  entered  and  adjusted  by  the  user 
to  visually  fit  the  borders  of  the  desired  ROI.  AVS  is 
available  for  most  Unix  workstations  and  on  Windows 
NT  systems.  This  was  done  to  create  reproducible  ROI 
measurements  and  to  help  standardize  the  method  of  data 
acquisition  between  different  sets  of  data.  Subsequent  to 
the  analysis  reported  here,  versions  in  AVS  Express  are 
now  mouse-driven  on  the  images  and  ROIs  are  arbitrari¬ 
ly-oriented  ellipsoids  and  ellipsoidal  annuli  fit  by  least 
squares  to  a  few  border  points  marked  on  multiple  slices 
or  orthogonal  views.  Both  ellipsoidal  versions  represent 
compromise  between  totally  free  shaping  of  the  ROI  (by 
laborious  marking  of  borders  on  all  slices  and  with 
cumbersome  display  and  computations)  and  the  rectan¬ 
gular  ROI  typically  available  on  imaging  systems.  The 
quantities  were  calculated  for  each  case  in  each  of  the 
regions  of  interest  in  Table  2  that  could  be  identified.  The 


3-D  image  sets  in  both  Doppler  image  modes  were 
carefully  compared  to  select,  as  well  as  possible,  the 
same  ROIs  in  both  p-CDI  and  f-CDI  image  sets. 

Because  the  two  sets  of  images  were  obtained  from 
sequential  series  of  3-D  scans,  spatial  matching  of  p-CDI 
and  f-CDI  coded  pixels  was  quite  crude  for  the  pixel-by¬ 
pixel  calculation  of  SNPD.  For  the  matching  of  the  entire 
ROIs  required  for  calculation  of  v  •  NPD  within  any 
region,  the  image  set  registration  by  ROI  selection  was 
generally  adequate  to  compensate  for  relative  motion  of 
the  tissue  and  hand-held  scanner  frame.  Normalization  of 
the  power  signal  was  done  with  respect  to  the  mean 
signal  power  centered  in  the  largest  vessel  at  or  near  the 
depth  of  the  lesion. 

RESULTS 

Although  data  have  been  collected  for  39  subjects, 
1 1  were  presumed  normal  or  the  preliminary  diagnoses 
were  unconfirmed.  Some  early  studies  were  not  quanti¬ 
fied  correctly  or  the  mass  was  missed  on  the  3-D  scans. 
Some  of  the  startup  quantification  errors  included  use  of 
incorrect  color  maps  and  other  system  settings,  as  well  as 
extensive  flash  artifact.  Analyzable  data  on  the  region  of 
a  mass  were  obtained  in  20  cases  with  p-CDI  and,  in  17 
of  those  cases,  f-CDI  was  obtained  as  well.  This  pro¬ 
vided  20  cases  for  NPD^  and  17  for  Vm  •  NPD^.  In  all 
the  malignant  and  fibroadenoma  cases  analyzed,  a  mass 
could  be  identified  from  grey-scale  ultrasound.  Lesion 
detection  was  sometimes  guided  by  the  local  vascularity. 
In  three  of  the  benign  cases,  the  mass  could  not  be  found 
ultrasonically  and  a  region  of  relatively  high  vascularity 
at  least  1.5  cm  diameter  was  selected  as  the  “lesion.” 
Subjects  in  whom  the  signals  were  analyzed  quantita¬ 
tively  are  given  in  Table  3. 

As  examples  of  some  of  the  measured  quantities, 
the  ranges  and  means  of  the  NPD  and  SNPD  for  one  of 
the  regions-of-interest  (ROI  1)  are  shown  in  Table  4  for 
the  three  different  lesion  types.  The  signal  was  normal¬ 
ized  to  the  signal  power  from  the  largest,  strongest  signal 
area  at  about  the  same  depth  as  the  mass.  ROI  1  is 
defined  in  Table  2  by  an  ellipsoidal  annulus  between  the 
lesion  boundary  and  1  cm  inside.  There  is  considerable 
overlap  for  the  individual  results  in  this  single  ROI,  but 
the  means  of  NPD  for  malignant  masses  in  this  region  are 
differentiated  reasonably  well  from  benign  conditions, 
particularly  those  other  than  fibroadenoma.  Means  of 
SNPD  from  ROI  1  also  are  quite  different  for  malignant 
than  for  both  benign  classifications. 

The  NPD  and  SNPD  in  Region  4  are  not  particu¬ 
larly  good  individual  classifiers  of  cancer.  They  revealed 
the  significant  vascularity  in  the  outer  periphery  of  fibro¬ 
adenomas.  Tables  4  and  5  reveal  large  ranges  of  the  two 
measures,  even  in  ROI  1,  and  suggest  that  single  mea- 
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Fig.  1.  3-D  display  from  a  49-y-old  subject  with  an  infiltrating  ductal  carcinoma.  Clockwise  from  top  left,  vascularity 
detected  in  f-CDI  mode  is  displayed  (a)  in  one  of  the  actual  scan  planes,  and  (b-d)  in  three  orthogonal  planes.  In  (a), 
the  grey-scale-delineated  mass  is  marked  with  the  arrow.  In  (b-d),  the  border  of  ROI  1  is  shown  as  a  smooth, 
translucent,  bluegreen,  ellipsoidal  surface.  The  large  white  arrow  in  (b)  shows  the  line  of  contact  of  the  scan  head  in  the 
actual  scanned  plane  and  the  dual  arrows  mark  a  plane  at  a  constant  depth  from  the  surface,  a  C-plane.  Vascularity  in 
the  scan  plane  and  penetrating  into  the  main  tumor  mass  (ROI  1)  is  marked  with  small  arrows,  (c)  Shows  the  same  planes 
as  (b),  but  with  a  different  viewing  angle.  Also,  the  vascularity  throughout  the  3-D  volume  is  shown  as  light  blue  3-D 
isosurfaces  (arrow),  often  obscuring  the  f-CDI  colors  lying  within  the  individual  planes.  With  rotation  and  stepping  of 
planes,  the  3-D  vascularity  isosurfaces  display  the  vascular  morphology  quite  well,  (d)  Is  the  same  as  (b),  but  viewed 
from  the  back  side  of  the  scanned  plane.  A  dark  blue  ellipsoid  shows  the  margins  of  the  external  periphery,  ROI  4. 


sures  in  individual  ROIs  may  not  be  good  indicators  of 
overall  discrimination  ability  of  ultrasound. 

Stepwise  linear  discriminant  analyses  were  used  as 
an  exploratory  tool  to  identify  likely  variables  and  com¬ 
binations  of  variables  in  specific  ROIs  to  discriminate 
between  benign  and  malignant  masses.  The  quality  of  a 
given  discriminant  function  was  evaluated  by  the  cross- 
validated  miselassification  rates,  and  the  importance  of 
variables  within  those  functions,  by  a  t-test  on  the  pa¬ 


rameter.  The  only  variable  consistently  identified  as  a 
discriminator  between  benign  and  malignant  masses  was 
speed- weighted  color  pixel  density  (SWD)  in  Region  1, 
the  internal  periphery  of  the  lesion.  A  tree-based  classi¬ 
fication  method  was  also  employed  and  it  consistently 
selected  only  power-weighted  pixel  density  (PD),  also 
from  Region  1.  In  Region  1,  for  100%  correct  identifi¬ 
cation  of  benign  lesions,  50,  38  and  50%  of  cancers  were 
correctly  identified  with  SWD,  PD  and  v  •  NPD,  respec- 
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Table  3.  Subjects  examined  and  analyzed. 


Analyzed  for 


Studied 

Analyzed  for  NPO^ 

Vm  ‘  NPDm 

Presumed  normal 

8 

Fibroadenoma 

7 

4 

3 

Benign 

8 

7 

7 

Malignant 

13 

9 

7 

Unconfirmed 

3 

- 

- 

tively.  At  other  thresholds,  these  true  cancer  and  true 
benign  rates  were,  respectively,  100%  and  60%  for 
SWD,  75%  and  75%  for  PD  and  67%  and  89%  for  v  • 
NPD. 

More  promising  results  were  obtained  when  the 
highest  value  of  a  variable  for  any  one  of  the  mass- 
related  regions  was  analyzed,  rather  than  looking  at  a 
specific  variable  in  a  specified  ROI.  Two  measures  that 
made  the  most  promising  scatterplots  in  conjunction  with 
the  average  of  all  6  grey-scale  visual  classifications  were 
the  NPDm  (peak  normalized  power-weighted  pixel  den¬ 
sity)  in  any  of  a  subject’s  Regions  1,  2, 4,  5  &  6  and  Vjyj  • 
NPDm,  in  any  one  of  those  same  regions.  Region  3  was 
the  only  other  region  associated  with  the  mass.  It  was  not 
included  because  of  its  rare  and  inconsistent  vascularity, 
although  the  small  amount  of  vascularity  in  that  region 
should  not  have  affected  the  peak  values  discussed  here. 

Figure  2  shows  such  a  scatterplot  of  log  NPDm  and 
the  average  of  all  6  grey-scale  visual  classifications  for 
each  subject.  The  malignant  masses  clustered  near  the 
upper  right  hand  comer,  as  expected.  The  benign  mass 
on  the  upper  right,  with  a  grey-scale  rating  of  3.0,  was  a 
rare  case  of  bilateral  diabetic  mastopathy,  that  met  many 
of  our  ultrasonic,  mammographic  and  clinical  criteria  for 
cancer.  The  cancer  with  the  lowest  vascularity  index  had 
multiple  small  areas  of  flow  in  the  proximal  periphery  of 
the  mass  {Le.,  the  vascularity  appeared  lobular  for  what 
turned  out  to  be  a  lobular  carcinoma).  Discriminant  anal¬ 
ysis  on  cancer  vs.  all  benign  masses  provided  the  clas- 


Table  4.  Examples  of  two  mass  quantities  for  ROI  1,  the 
lesion  internal  periphery. 


N 

Min 

Max 

Mean 

NPD  (Lesion  periphery  to 

1  cm  inside  mass) 

Benign 

7 

0.00000 

0.00086 

0.00029 

Adenoma 

4 

0.00001 

0.01088 

0.00324 

Malignant 

SNPD  (Lesion  periphery  to 

9 

0.00000 

0.03718 

0.00577 

1  cm  inside  mass) 

Benign 

7 

0.00000 

0.00193 

0.00038 

Adenoma 

3 

0.00000 

0.00244 

0.00097 

Malignant 

7 

0.00000 

0.03800 

0.00618 
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Table  5.  NPD  and  SNPD  measures  from  ROI  4,  which  is 
defined  as  an  ellipsoidal  annulus  between  the  lesion 
boundary  and  1  cm  outside. 


N 

Min 

Max 

Mean 

NPD  (Lesion  periphery  to 

1  cm  outside  mass) 

Benign 

7 

0.00002 

0.00668 

0.00167 

Adenoma 

4 

0.00007 

0.01500 

0.00472 

Malignant 

9 

0.00000 

0.00684 

0.00210 

SNPD  (Lesion  periphery  to 

1  cm  outside  mass) 

Benign 

7 

0.00000 

0.00311 

0.00078 

Adenoma 

3 

0.00003 

0.02582 

0.00925 

Malignant 

7 

0.00000 

0.02541 

0.00400 

sification  lines  log  NPD^^  =  1.55  GS  -I-  2.4  and  log  v^  • 
NPDm  =  1.27  GS  +  3.0,  where  GS  is  the  average 
grey-scale  rating.  The  sensitivities  of  100%  and  speci¬ 
ficities  of  82%  and  90%,  for  MPD^i  and  v^^  •  NPD^^, 
respectively,  are  promising,  but  the  statistical  uncertainty 
in  these  numbers  is  large.  Figure  3  shows  a  scatter  plot  of 
log  Vn^  •  NPDjyi  (peak  v  and  peak  NPD)  and  the  average 
visual  grey-scale  for  each  subject  studied.  Note  that  all 
the  measures  of  malignant  masses  are  clustered  near  the 
upper  right-hand  comer  and  appear  better  differentiated 
from  the  benign  measures  than  in  Fig.  2.  A  line  can  be 
selected  visually  in  Fig.  2  that  provides  100%  sensitivity 
and  100%  specificity. 

The  vascularity  of  malignant  lesions,  as  measured 
by  the  log  of  NPD^  among  the  five  regions,  did  decrease 
significantly  as  a  function  of  age.  The  linear  regression 
was  log  NPDm  =  -0.028  (±0.007)  X  Age  -0.47.  The 


Fig.  2.  Scatterplot  of  log  NPD^^  and  grey-scale  readings.  Sym¬ 
bols  are:  benign  =  open  circles;  fibroadenomas  =  open  trian¬ 
gles;  cancer  =  solid  squares.  The  linear  discriminator  is  shown 
as  the  solid  line. 
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Gray  Scale  Rating 

Fig.  3.  The  digital  vascularity  index  shown  here,  ‘  NPD^^ 
and  grey-scale  rating  are  over  the  regions  used  in  Fig.  2  and 
symbols  are  as  in  Fig.  2. 


intercept  and  slope  of  the  fit  were  insignificant  and  sig¬ 
nificant,  probability  <  |t|  =  0.22  and  0.006,  respectively 
(see  Fig.  4).  The  decrease  in  MPD^  with  age  suggests 
that  age  might  be  a  significant  discriminator  of  cancer 
along  with  NPDj^  and  grey-scale  rating.  However,  the 
number  of  data  points  in  this  study  is  too  small  for 
meaningful  3-variable  analysis.  Other  key  ultrasound 


Fig.  4.  Cancer  vascularity  as  a  function  of  age,  showing  a 
factor  of  45  decrease  in  peak  NPD  among  Regions  1,  2,  4,  5 
and  6  from  age  33  to  77  y.  There  is  some  uncertainty,  as 
shown  by  the  (dotted)  95%  confidence  limits  of  the  (solid) 
linear  regression  line. 


measures  were  not  a  significant  function  of  age  {e.g.,  log 
NPDm  for  benign  cases,  which  had  an  insignificant  but 
negative  slope  [|t|  >  0.12]).  An  increase  in  grey-scale 
reading  with  age  for  benign  cases  was  not  significant  nor 
was  an  increase  in  v^  •  NPDi^  with  age  for  benign  cases. 

DISCUSSION 

New,  normalized  measures  of  color  Doppler  image 
signals  have  been  developed  for  potential  assessment  of 
tumor  vascularity.  Ellipsoidal  ROIs  have  been  applied  in 
3-D  with  recently  developed  display  techniques  to  im¬ 
prove  the  sampling  statistics  and  reliability  of  defining 
ROIs  in  and  around  the  tumor,  compared  with  measure¬ 
ments  in  only  one  or  a  few  images. 

Although  the  measures  NPD  and  v  •  NPD  are  only 
an  approximation  to  true  fractional  blood  volume  or 
perfusion,  they  provide  quantification  of  what  the  clini¬ 
cian  sees  as  well  as  some  normalization  for  machine 
settings  and  ultrasound  attenuation  by  tissues  overlying 
the  areas  of  interest.  These  measures  may  provide  more 
reproducible  results  than  what  is  currently  done  clini¬ 
cally.  We  previously  referred  to  NPD  as  the  detected 
fractional  blood  volume  B^,  and  to  v  •  NPD  as  the 
speed-weighted  detected  fractional  blood  volume,  or 
even  perfusion  (Carson  et  al.  1993).  We  are  now  using 
the  acronyms  NPD  and  v  •  NPD,  or  their  longer  descrip¬ 
tive  names,  because  of  the  potential  for  overinterpreta¬ 
tion  of  the  more  vascularity-specific  terms. 

Speed-weighted  pixel  density  (SWD)  and  power- 
weighted  pixel  density  (PD)  in  Region  1  were  identified 
as  the  best  single  discriminators  in  single  ROIs.  These 
observations  are  consistent  with  one  recent  criterion  for 
discriminating  malignant  masses  as  those  in  which  the 
vessels  penetrate  the  mass  (Bergonzi  et  al.  1993;  Calliada 
et  al.  1994;  De  Albertis  et  al.  1995). 

The  discrimination  by  either  of  these  single  vari¬ 
ables  in  Region  1  alone  was  relatively  poor.  The  less- 
than-stellar  results  of  the  linear  discriminant  and  tree- 
based  classification  analyses  might  be  expected,  given 
the  heterogeneity  of  cancer  growth.  Also,  the  statistical 
effects  of  small  numbers  of  subjects  were  compounded 
by  the  relatively  poor  vascularization  of  the  breast,  so 
that  there  were  large  fluctuations  in  the  vascularity  in  any 
one  ROI  detectable  with  the  relatively  high-frequency 
techniques  employed  for  visualization  of  vascular  mor¬ 
phology.  It  is  possible  that  these  statistical  considerations 
were  a  reason  that  normalization  did  not  improve  the 
vascularity  measures  in  individual  ROIs  in  the  same  way 
that  it  did  with  the  peak  measures.  The  sparse  vascularity 
made  it  not  always  possible  to  obtain  an  appropriate 
normalization  value  for  each  ROI. 

Those  concerns,  including  the  anticipated  tumor 
heterogeneity,  were  the  basis  for  calculating  the  normal- 
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ized  measures  NPDjyj  and  •  NPD^  from  the  peak 
value  of  NPD  over  the  five  employed  regions  associated 
with  the  mass  and,  separately,  the  maximum  of  v  over 
those  five  ROIs.  This  utilization  of  peak  values  from 
possibly  different  ROIs  provided  the  best  discrimination 
on  scatter  plots  as  a  function  of  grey-scale  ratings.  This 
relative  success  is  consistent  with  the  possibility  that,  due 
to  shunting  and  other  flow  phenomena,  peak  v  might  be 
higher  in  one  region  associated  with  the  tumor  and  high 
volumes  of  Doppler-imageable  blood  might  be  in  an¬ 
other  region.  The  specificity  and  sensitivity  obtained 
using  NPDm  or  Vj,^  •  NPD^^  in  conjunction  with  mean 
grey-scale  rating  were  consistent  with  or  slightly  higher 
than  those  obtained  with  visual  vascularity  and  grey¬ 
scale  ratings  (Carson  et  al.  1997). 

Decreased  vascularity  with  age  is  to  be  expected  in 
the  normal  breast,  likely  related  to  fatty  replacement  of 
glandular  tissue  in  aging.  The  clear  relation  seen  for 
NPD^^  with  age  suggests  that  ultrasound  vascularity 
measures  as  an  indicator  for  cancer  or  for  general  tumor 
aggressiveness  would  be  improved  by  normalizing  for 
age. 

Although  these  results  are  promising,  the  wide 
ranges  of  the  vascularity  measurements  indicate  that 
some  breast  cancers  have  very  little  detectable  blood 
flow  due  to  either  low  volume  or  low  velocities.  Some 
malignant  cases  only  had  vascularity  in  Region  6,  a 
region  associated  with  the  mass  but  more  than  1  cm 
away,  suggesting  fine  vessel  branching  upstream  from 
the  cancer  or  most  active  perfusion  well  outside  the 
cancer. 

On  either  Fig.  2  or  Fig.  3,  a  vertical  line  from  the 
combined  grey-scale  score  provides  better  discrimination 
in  these  data  than  does  a  horizontal  line  from  either 
single  vascularity  measure.  Vascularity  will  not  be  the 
sole  criterion  in  most  breast  cancers,  but  it  should  con¬ 
tribute  to  the  diagnosis  because  more  malignant  and 
benign  masses  were  classified  correctly  here  with  inclu¬ 
sion  of  the  vascular  results.  This  additional  discrimina¬ 
tion  was  not  statistically  significant  in  this  small  set  of 
subjects.  These  results,  along  with  the  known  vascular 
characteristics  of  cancer  such  as  localized  shunting  and 
blood  pooling,  do  provide  the  basis  for  the  hypotheses  of 
a  future  study  on  an  independent  (test)  set  of  subjects. 
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Future  Directions  in  Diagnostic  US^ 


From  modest  beginnings  about  50  years 
ago,  ultrasonography  (US)  has  become 
the  most  rapidly  growing  diagnostic  imag¬ 
ing  method  in  worldwide  use  today.  Its 
versatility,  portability,  low  cost,  and  effi¬ 
cacy  have  made  US  an  indispensable  tool 
in  patient  care.  Recently,  the  value  of  US 
has  been  enhanced  by  improvements  in 
both  imaging  and  Doppler  technology 
and  the  development  of  echo-enhancing 
agents. 

Diagnostic  US  is  based  on  the  scatter¬ 
ing  of  sound  by  tissue.  Current  methods 
of  detecting  and  displaying  amplitude 
and  frequency  contents  of  the  backscat- 
tered  ultrasound  echoes  have  achieved 
high  sensitivity  and  resolution,  permit¬ 
ting  excellent  imaging  of  soft  tissues  and 
detection  and  characterization  of  tissue 
motion  and  blood  flow  in  real  time.  Ben¬ 
efiting  from  dramatic  improvements  in 
computer  power,  basic  US  functions  of 
gray-scale  imaging  and  Doppler  are  ex- 
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pected  to  become  even  more  powerful  in 
the  future.  Even  more  exciting  possibili¬ 
ties  arise  from  the  exploration  of  the 
complex  interaction  of  sound  with  tis¬ 
sues  to  develop  opportunities  for  novel 
methods  of  imaging  that  are  not  possible 
with  other  methods.  Opportunities  for 
further  progress  in  diagnostic  US  are  the 
following:  (a)  improved  signal  detection: 
echo-enhancing  agents  (contrast  agents), 
harmonic  imaging;  (b)  improved  image 
display;  three-dimensional  US;  (c)  novel 
methods:  anisotropic  imaging,  perfusion 
imaging,  co-registration,  elastography; 
(d)  instrumentation:  miaoimaging,  endo- 
imaging,  telesonography;  (e)  therapy  and 
intervention;  high-intensity  focused  ultra¬ 
sound  therapy,  guidance,  gene  therapy; 
( f)  applications:  intraoperative  and  endo¬ 
scopic. 

New  developments  that  will  affect  the 
future  of  US  are  currently  in  progress  and 
will  constitute  the  focus  of  this  overview. 
They  include  contrast  agents,  intraopera¬ 
tive  and  endoscopic  applications,  and 
three-dimensional  imaging.  Several  other 
areas  of  development  included  in  this 
discussion  have  not  yet  substantially  pen¬ 
etrated  clinical  US  but  show  promise  for 
altering  and  improving  the  practice  of  US. 

Contrast  Agents 

Contrast  agents  (1-8)  improve  US  by 
increasing  the  echo  strength  from  within 
the  body  rather  than  by  altering  the  US 
equipment.  US  contrast  agents  address 
several  fundamental  acoustic  difficulties 
in  imaging  patients  when  there  may  be 
insufficient  US  contrast  between  diseased 
tissues  and  normal  regions  because  the 
acoustic  properties  are  not  substantially 
different.  Also,  Doppler  is  less  reliable  in 
slow-flow  velocities  and  in  low-volume 
flow  rates  such  as  in  high-grade  stenoses, 
in  which  there  are  few  moving  erythro¬ 
cytes  to  produce  an  adequate  signal. 


Doppler  signals  also  may  be  inadequate 
due  to  attenuation  in  such  situations  as 
deep  vessels  or  when  overlying  plaque  or 
bone  diminishes  the  echo  strength  return¬ 
ing  to  the  transducer. 

The  pharmaceutical  industry  is  now 
creating  a  variety  of  US  contrast  agents. 
Agents  being  investigated  include  intrave¬ 
nous  blood-pool  agents  that  increase 
Doppler  and  gray-scale  US  signals  systemi- 
cally,  and  enteral  agents  that  improve 
visualization  of  the  bowel  and  the  ab¬ 
dominal  organs  beneath  the  bowel.  Com¬ 
panies  have  begun  to  market  contrast 
agents  overseas  for  radiologic  and  cardiac 
applications  and  in  the  United  States  for 
echocardiography. 

Intravenous  contrast  agents  rely  on  mi¬ 
crobubbles  of  gas  to  strengthen  the  ech¬ 
oes  by  inaeasing  backscatter.  Manufactur¬ 
ing  techniques  ensure  that  there  is 
imiformity  of  a  small  bubble  size  that 
permits  the  bubbles  to  cross  the  pulmo¬ 
nary  circulation  and  capillary  beds.  Vari¬ 
ous  designs  have  been  used  to  keep 
bubbles  intact  so  that  the  duration  of 
enhancement  can  be  extended  to  min¬ 
utes.  These  designs  include  the  use  of 
fluorocarbons  or  other  gases  to  resist  dis¬ 
solution  and  the  use  of  a  coating  or  shell 
over  the  bubbles  to  make  them  more 
resistant  to  destruction.  The  quantity  of 
gas  used  is  quite  small,  and  the  materials 
used  with  the  gas  are  chosen  to  be  as  inert 
as  possible,  leading  to  safety  profiles  that 
have  been  quite  good  in  clinical  trials. 

Clinical  trials  of  contrast  agents  have 
shown  that  both  spectral  and  color  Dopp¬ 
ler  signals  are  increased  after  intravenous 
administration.  Contrast  material  has 
been  administered  to  a  variety  of  sites, 
with  the  largest  experience  in  the  renal 
and  liver  circulations.  Studies  of  both  the 
main  renal  arteries  (Fig  1)  and  intrarenal 
waveforms  have  shown  improved  imag¬ 
ing  performance  and  faster  examinations 
because  of  intravenous  administration  of 


a.  b. 


Figure  1.  Normal  renal  artery  (angiographically  proved)  initially  misinterpreted  at  US  as  renal  artery  stenosis,  (a)  Baseline  Doppler  image  shows  a 
portion  of  the  renal  artery  (arrows).  Spectral  Doppler  image  Initially  showed  increased  velocity  since  the  vessel  was  assumed  to  be  straight  and  an 
incorrect  spectral  Doppler  angle  was  assigned  (not  shown),  (b)  Contrast  material-enhanced  Doppler  image  shows  a  longer  length  of  the  renal  artery 
and  shows  that  the  vessel  actually  has  a  tortuous  course  (arrow).  The  Doppler  angle  was  then  correctly  assigned,  and  no  elevated  velocity  was  found. 


contrast  material.  US  examination  in  dif¬ 
ficult  liver  cases  such  as  slow  flow  in 
portal  veins  in  patients  with  cirrhosis  and 
in  complete  interrogation  of  transjugular 
intrahepatic  portosystemic  shunts  has  also 
been  shown  to  be  more  accurate  after 
administration  of  contrast  material.  More 
complete  transcranial  Doppler  signals  can 
be  obtained  after  administration  of  con¬ 
trast  material.  Contrast  material  cannot 
make  a  signal  appear  where  the  area  of 
interest  is  completely  obscured  by  bowel 
gas,  but  it  can  improve  a  partial  signal 
that  may  be  present.  If  contrast  material 
can  improve  confidence  in  a  negative 
examination  or  prove  there  is  a  pseudo¬ 
occlusion,  confirmatory,  often  more  ex¬ 
pensive  testing  can  be  eliminated.  Gray¬ 
scale  enhancement  also  is  possible  with 
some  agents  (Fig  2). 

US  studies  with  use  of  contrast  agents 
initially  will  be  used  in  selected  cases  in 
which  US  information  is  incomplete  or 
difficult  to  obtain.  This  may  be  applied  to 
individual  patients  or  to  all  who  will 
undergo  a  technically  demanding  study, 
such  as  renal  artery  or  transcranial  Dopp¬ 
ler  studies.  Absence  of  nephrotoxicity  may 
help  make  it  an  attractive  alternative  to 
iodinated  contrast  material  in  certain 
other  patients.  Wider  adoption  of  US 
contrast  agents  will  depend  on  whether 
they  can  improve  accuracy  or  efficiency 
in  more  routine  cases.  Studies  of  accu¬ 


racy,  patient  outcomes,  and  costs,  with 
larger  numbers  of  patients,  will  further 
clarify  the  role  of  these  contrast  agents. 

For  contrast  agents  to  be  widely  adopted 
in  radiologic  practice,  several  obstacles 
must  be  overcome.  US  is  perceived  to  be 
completely  noninvasive.  This  changes 
with  an  intravenous  injection,  but  the 
invasiveness  may  be  acceptable  if  the  test 
is  more  accurate,  the  cost  is  modest,  and 
the  administration  is  not  burdensome. 
Even  with  an  added  cost,  contrast  agents 
may  be  effective  if  they  can  eliminate  the 
negative  consequences  of  inadequate  or 
inaccurate  US  or  obviate  the  use  of  alter¬ 
native,  more  expensive,  and  sometimes 
riskier  tests. 

Further  uses  of  microbubble  US  agents 
are  actively  being  investigated.  Agents 
with  specialized  applications,  such  as  or¬ 
gan-  or  disease-seeking  materials,  are  be¬ 
ing  evaluated.  Some  agents  are  removed 
by  the  reticuloendothelial  system  and 
can  enhance  normal  liver  but  not  tumors, 
which  lack  these  cells.  It  is  hoped  that 
this  will  improve  the  sensitivity  of  he¬ 
patic  US.  Agents  that  attach  to  pathologic 
tissues  are  also  being  developed.  For  in¬ 
stance,  some  agents  have  been  shown  to 
attach  to  thrombi.  This  approach  may 
have  therapeutic  implications.  Micro¬ 
bubbles  of  a  disease-seeking  agent  can 
contain  gas  and  a  chemotherapeutic 
agent.  After  the  bubble  attaches  to  the 


abnormality,  a  higher  energy  ultrasound 
beam  can  break  the  bubble  and  release 
the  medicine  locally  for  a  potentially 
greater  response  than  with  traditional 
administration.  US  equipment  also  is  be¬ 
ing  changed  to  use  contrast  material  more 
effectively.  One  promising  approach  is 
harmonic  imaging.  Since  bubbles  reso¬ 
nate  nonlinearly,  they  emit  harmonic 
frequencies,  in  which  case  the  instru¬ 
ment  receives  echoes  at  a  different  fre¬ 
quency  than  is  transmitted.  Contrast  ef¬ 
fects  may  be  seen  better  or  for  a  longer 
time  with  use  of  harmonic  rather  than 
fundamental  frequencies.  Other  proper¬ 
ties  of  bubbles  are  being  investigated  to 
exploit  their  unique  properties.  Bubbles 
behave  differently  at  different  pressures, 
which  may  allow  noninvasive  determina¬ 
tion  of  blood  pressure.  It  can  thus  be  seen 
that  microbubble  agents  have  a  vast  po¬ 
tential  role  in  improving  US  imaging. 

Intraoperative  and  Endoscopic 
Applications 

US  has  been  keeping  pace  with  the 
radical  changes  in  surgery  and  continued 
growth  of  endoscopic  procedures.  Intraop¬ 
erative  US  is  an  established  accurate  tool 
for  surgical  decision  making.  US  imaging 
using  specially  designed  laparoscopic  US 
probes  is  another  effective  tool  for  provid¬ 
ing  important  information.  Laparoscopy 
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Figure  2.  Liver  metastasis,  (a)  Baseline  US  image  shows  a  neatly  Isoechoic  liver  lesion  (arrows)  that  is  difficult  to  distinguish  from  adjacent  normal 
liver,  (b)  After  intravenous  administration  of  contrast  material,  there  is  gray-scale  enhancement  of  the  liver,  and  the  lesion  stands  out  as  hypoechoic 
(*)  against  the  more  echogenic  liver.  The  blood  has  markedly  increased  echogenicity,  and  the  portal  veins  ate  markedly  echogenic  (arrows).  Some 
portal  veins  shadow  from  the  amount  of  contrast  agent  within  them. 


can  eliminate  needless  surgery  and  can 
decrease  the  need  for  hospitalization. 
Cryoablation  can  now  be  performed  lapa- 
roscopically  in  some  patients.  Endo¬ 
scopic  US  is  another  growing  technique 
that  can  help  to  stage  gastrointestinal 
tumors  and  guide  biopsies  and  other  inter¬ 
ventions.  Smaller  laparoscopic  and  more 
flexible  endoscopic  designs  will  allow 
these  procedures  to  become  even  easier 
and  more  routine.  The  role  of  miniature 
transducers,  initially  designed  for  intravas¬ 
cular  US,  is  being  expanded  to  image 
many  structures  such  as  the  ureter, 
esophagus,  and  anal  canal.  Design 
changes  will  allow  better  imaging  through 
these  tiny  probes  as  well.  The  surgeon 
and  endoscopist  need  an  imaging  test  to 
show  them  what  is  below  the  surface  and 
to  guide  therapy.  Radiologists  should  be 
prepared  to  be  part  of  the  team  providing 
diagnostic  US  during  these  procedures  or 
be  left  behind  as  this  revolution  sweeps 
across  medicine. 

Three-dimensional  US 

Three-dimensional  US  is  a  new,  excit¬ 
ing  technology  that  allows  physicians  to 
use  US  to  view  anatomy  and  pathologic 
conditions  as  a  volume,  thereby  enhanc¬ 
ing  comprehension  of  patient  anatomy 
(9-11).  Ongoing  developments  in  com¬ 
puters  and  technology  now  permit  acqui¬ 


sition,  analysis,  and  display  of  volume 
data  in  seconds,  facilitating  many  oppor¬ 
tunities  for  rapid  diagnosis  and  interven¬ 
tional  techniques.  Both  commercial  and 
academic  interest  in  three-dimensional 
US  is  mounting,  and  continued  advance¬ 
ments  and  understanding  are  expected  in 
the  near  future. 

Thus  far,  three-dimensional  US  has 
demonstrated  several  advantages  com¬ 
pared  with  two-dimensional  US.  First, 
volume  data  can  be  viewed  by  using  a 
standard  anatomic  orientation  with  pla¬ 
nar  images  to  obtain  simultaneous  dis¬ 
play  of  coronal,  sagittal,  and  axial  planes 
in  addition  to  orientations  that  are  diffi¬ 
cult  or  impossible  to  obtain  with  conven¬ 
tional  two-dimensional  US  due  to  ana¬ 
tomic  constraints  (eg,  coronal  plane  of 
the  uterus).  Second,  rendering  of  the  en¬ 
tire  volume  allows  the  continuity  of 
curved  structures  such  as  liver  vessels,  the 
fetal  spine,  or  fetal  face  to  be  viewed  in  a 
single  image.  Additionally,  by  rotating 
the  volume  interactively,  it  is  possible  to 
view  the  structure  from  multiple  orienta¬ 
tions  or  perspectives  that  enhance  under¬ 
standing  of  patient  anatomy.  Third,  more 
accurate  measurement  of  organ  volume 
and  irregularly  shaped  objects  may  be 
readily  obtained  (12).  Fourth,  volume  data 
may  be  used  to  guide  interventional  pro¬ 
cedures  providing  accurate  identification 
of  needle  or  catheter  placement.  Fifth, 


volume  data  may  be  archived  and  subse¬ 
quently  reviewed  for  further  critical  re¬ 
view  or  teaching  purposes  on  site  or  via 
the  Internet  after  the  patient  has  left  the 
clinic. 

Ongoing  clinical  research  is  evaluating 
clinical  applications  likely  to  have  the 
greatest  effect  on  diagnosis  and  patient 
care.  To  date,  fetal  (13,14),  cardiac  (15- 
17),  and  gynecologic  (18)  areas  have  re¬ 
ceived  the  most  attention  with  other 
clinical  areas  receiving  increasing  inter¬ 
est,  including  imaging  of  vascular 
anatomy,  prostate  volume  measurement 
and  assessment  of  seed  placement,  guid¬ 
ance  of  interventional  needles  and  cath¬ 
eters,  neonatal  head  evaluation,  and 
evaluation  of  breast  mass  vascularity  (19). 
In  the  fetus,  improved  visualization  of 
fetal  features,  including  the  face  (Fig  3), 
spine,  and  limbs,  has  improved  identifica¬ 
tion  of  anomalies  and  has  been  immedi¬ 
ately  appealing  for  clearly  sharing  devel¬ 
opmental  information  with  the  family 
and  colleagues.  Cardiac  applications  have 
provided  a  "surgeon's-eye  view"  with  use 
of  transesophageal  and  transthoracic  tech¬ 
niques  to  assess  valve  geometry  and  mo¬ 
tion  and  plan  operative  procedures. 

Gynecologic  applications  include  evalu¬ 
ating  congenital  anomalies  of  the  uterus, 
endometrial  cancer,  adnexal  masses,  intra¬ 
uterine  device  position,  and  follicular 
cysts.  Applications  in  other  specialties 
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Figure  3.  (a)  Sagittal  section  through  a  three-dimensional  US  volume  data  set  of  a  3S-week-old  fetus  is  similar  to  a  conventional  two-dimensional 
US  image  of  the  facial  profile,  (b)  Rendered  view  of  the  face  from  the  same  volume  provides  a  more  recognizable  picture  of  the  face,  (c)  Rendered  view 
of  another  35-week-old  fetus  with  cleft  lip/palate  and  h)TJOteloiism.  The  rendered  images  clearly  demonstrate  both  normal  and  abnormal  anatomy 
in  a  readily  comprehended  fashion. 


such  as  urology,  gastroenterology,  derma¬ 
tology,  and  ophthalmology  are  expand¬ 
ing  the  range  of  applications  for  three- 
dimensional  US  methods. 

Coming  soon  will  be  further  develop¬ 
ments  that  will  broaden  the  adoption  of 
three-dimensional  US  imaging  world¬ 
wide,  including  (a)  improved  overall  scan¬ 
ning  system  performance  and  smaller 
scanners  and  transducers,  (b)  improved 
user  interfaces  making  it  easier  to  evalu¬ 
ate  volume  data  and  understand  patient 
anatomy,  (c)  physiologic  gating  with  both 
the  cardiac  and  respiratory  cycles  elimi¬ 
nating  motion  artifacts  and  opening  a 
window  to  dynamic  processes,  (d)  combi¬ 
nation  of  volume  imaging  and  US  con¬ 
trast  agents  to  enhance  visualization  of 
vascular  anatomy  (Fig  4),  (e)  faster  vol¬ 
ume  acquisition,  analysis,  and  interactive 
displays,  ultimately  leading  to  (f)  real¬ 
time  volume  imaging  in  the  near  future. 

Ultimately,  three-dimensional  US  tech¬ 
nology  will  provide  a  central  integrating 
focus  in  US  imaging.  Three-dimensional 
US  equipment  will  provide  more  conven¬ 
tional  two-dimensional  US  imaging  capa¬ 
bility  but  seamlessly  expand  imaging  to 
include  volume  acquisition  and  display 
as  necessary  to  obtain  the  diagnosis.  Fo¬ 
cused  application  of  three-dimensional 
US  methods  will  expand  the  areas  in 


which  US  is  the  predominant  imaging 
modality  beyond  those  areas  in  which  US 
currently  is  the  method  of  choice. 
Through  rapid  transmission  of  volume 
data  to  specialists  at  distant  locations, 
patient  care  will  benefit  from  improved 
diagnosis  and  treatment. 

Aisotropic  Imaging 

Anisotropy,  directional  dependency,  of 
the  amplitude  of  a  backscattered  wave  is  a 
well-known  property  of  US  (20-24).  Tis¬ 
sues  in  which  backscatter  anisotropy  has 
been  recognized  include  the  renal  cortex, 
myocardium,  cerebral  periventricular  ar¬ 
eas,  and,  most  prominently,  muscles  and 
tendons.  Anisotropy  has  mostly  been  a 
curiosity  whose  clinical  importance  rested 
only  in  recognizing  its  existence  and  ac¬ 
counting  for  its  effects  on  images.  It  has 
never  seriously  been  employed  as  a 
method  of  diagnosis  or  enhancement  of 
echo  contrast.  Yet,  the  effects  of  anisot¬ 
ropy  on  backscatter  can  be  huge,  with 
angle-dependent  backscattered  differ¬ 
ences  having  been  measured  that  can 
vary  by  orders  of  magnitude  (25,26).  One 
could  employ  these  very  large  dynamic 
ranges  in  differentiating  normal  aniso¬ 
tropic  tissue  from  isotropic  abnormalities 
such  as  tendon  tears  or  in  measuring 


surface-roughening  effects  of  diseases  as 
in  osteoarthritis.  Preliminary  studies  have 
shown  remarkable  angle-dependent  sen¬ 
sitivities  for  backscattered  ultrasound. 
Roughnesses  as  small  as  5  pm  (root-mean 
squared),  easily  small  enough  to  detect 
the  earliest  structural  changes  in  osteoar¬ 
thritis,  can  be  detected  even  with  the  use 
of  standard  diagnostic  frequency  (5-MHz) 
transducers  (26,27).  Even  though  carti¬ 
lage  surface  may  be  difficult  to  visualize 
in  vivo,  it  and  other  areas  of  demon¬ 
strable  anisotropy  such  as  myocardium, 
renal  cortex,  and  tendons  are  waiting  to 
be  exploited. 

Perfusion  Imaging 

An  ultimate  goal  of  vascular  imaging  is 
blood  flow  perfusion.  In  US,  perfusion¬ 
like  estimates  (pixel  counting)  using  spec¬ 
tral  or  color  Doppler  abound  in  the  litera¬ 
ture,  but  actual  estimates  of  trae  perfusion 
are  rare.  Perfusion  represents  the  volume 
of  blood  per  mass  of  tissue  (fractional 
blood  volume)  divided  by  the  mean  tran¬ 
sit  time  of  the  blood  through  the  tissue. 
Recent  developments  in  blood  flow  quan¬ 
titation  appear  to  make  such  trae  perfu¬ 
sion  estimates  tractable.  New  techniques 
for  estimating  mean  transit  time  include 
Doppler-based  techniques  (28),  speckle 
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figure  4.  Three-dimensional  US  study  of  a  canine  kidney  after  administration  of  a  contrast  agent 
(Imagent;  Alliance  Pharmaceutical,  San  Diego,  Calif)  and  wide-hand  harmonic  imaging  (Siemens, 
Erlangen,  Germany),  (a)  Two-dimensional  US  images  of  the  kidney  obtained  during  data 
acquisition,  (b)  Three  volume-rendered  images  of  the  kidney  from  different  projections.  The 
continuity  of  the  renal  vasculature  is  clearly  visible.  Three-dimensional  US  combined  with  harmonic 
imaging  and  contrast  agents  provides  superior  spatial  and  temporal  resolution  compared  with  those  of 
conventional  Doppler  imaging  methods  for  the  evaluation  of  vascular  anatomy. 


decorrelation  techniques  (29),  both  of 
which  can  be  done  with  or  without  con¬ 
trast  agents,  and  methods  requiring  US 
contrast  agents  (30-32).  US  bubble  con¬ 
trast  agents  have  particular  advantages  in 
this  regard  since  they  are  totally  intravas¬ 
cular,  can  exploit  harmonic  imaging  to 
remove  soft-tissue  flash  artifact  (33),  and 
can  be  manipulated  externally  by  the 
ultrasound  beam  to  actually  alter  the 
bubble  distribution  in  vivo  (30-32).  In 
fact,  extremely  short  boluses  have  been 
generated  by  using  strongly  focused  exog¬ 
enous  ultrasound  sources  without  injec¬ 
tion  of  contrast  material  (34).  Such  ma¬ 
nipulations  can  potentially  remove  the 
previously  confounding  effects  of  separat¬ 
ing  bolus  shape  from  the  tissue  response 
making  mean  transit  time  estimates  trac¬ 
table.  Finally,  fractional  blood  volume 
estimates  can  now  be  made  either  with 
use  of  power  Doppler  with  or  without 
contrast  agents  or  gray-scale  imaging  with 
contrast  agents  (35,36).  Early  imaging 
with  these  techniques  has  produced  per¬ 
fusion  images  in  vivo  that  portend  a 


whole  new  class  of  US-based  diagnostic 
capabilities. 

Co-registration  of  Sequential  Images 

Co-registration  of  US  data  sets  from 
examinations  at  differenttimes  offers  the 
exciting  possibility  of  much  more  conisis- 
tent  and  sensitive  detection  of  changes  in 
tissues  between  studies  and  better  image 
quality.  This  could  open  new  possibilities 
for  screening  and  assessment  of  growth  of 
suspicious  regions  or  of  masses  during 
treatment.  The  three-dimensional  image 
registration  software,  MiamiFuse  (Univer¬ 
sity  of  Michigan,  Arm  Arbor),  was  origi¬ 
nally  developed  for  fusion  of  data  sets 
from  multiple  modalities  (37).  Its  initial 
application  to  US  images  (38)  has  re¬ 
quired  very  little  preprocessing  or  specific 
image  features,  as  the  software  is  based  ori 
a  statistical  maximization  of  a  measure 
aptly  referred  to  as  mutual  information. 
The  technique  appears  to  work  even  in  the 
presence  of  substantial  tissue  shear,  warp¬ 
ing,  and  limited  overlap  of  scan  regions. 


There  are  other  reasons  why  US  exami¬ 
nations  might  benefit  from  registration 
of  several  image  sets  or  examinations.  For 
example,  images  from  different  trans¬ 
ducer  positions  are  partially  uncorre¬ 
lated,  and  summing  them,  in  compound 
scanning,  can  improve  the  contrast-to- 
(speckle)  noise  ratio  (39).  Also,  multiple 
viewing  directions  may  depict  and  better 
represent  flow  than  can  a  single  view. 
This  technique  of  co-registration  by  mu¬ 
tual  information  might  be  conibined  with 
beam  reformatioii  (40,41)  for  aberration 
conection  to  realize  the  high  detail  resolu¬ 
tion  of  large  apertures.  Co-registration  of 
images  might  also  be  combined  \yith 
image-based  location  of  images  (42)  in  a 
freehand,  three-dimensional  scan  to  pro¬ 
vide  improved  image  quality  and  spatial 
fidelity.  This  is  particularly  appealing  in 
the  presence  of  respiratory  motion  during 
slow  scanning  required  for  sensitive  three- 
dimensional  imaging  of  vascularity. 

Limitations  on  Image  Improvement 
by  Safety  Considerations 

In  1992,  the  U.S.  Food  and  Dmg  Admin¬ 
istration  increased  the  limiting-guideline 
spatial-peak,  time-average  intensity  lev¬ 
els  for  all  applications  to  the  levels  previ¬ 
ously  allowed  only  for  peripheral  vascular 
studies  (43).  For  general  and  obstetric 
examinations,  these  intensities  were  al¬ 
lowed  to  increase  by  a  factor  of  almost  8. 
Since  that  time,  the  clear  improvement  in 
frame  rate  and  quality  of  color  flow  im¬ 
ages  and  of  multiple-focal-zone  gray¬ 
scale  images  has  been  made  possible 
largely,  and  at  little  increased  system  cost, 
by  the  change  in  allowed  output.  The  U.S. 
Food  and  Drug  Administration  acted 
(a)  because  professional  organizations  co¬ 
operated  with  industry  to  provide  users 
with  an  indication  of  the  relative  output 
in  the  most  biophysically  relevant  terms 
available — ^the  thermal  index,  TI,  and  the 
mechanical  index,  MI  (44);  and  (b)  on  the 
assumption  that  users  would  pay  atten¬ 
tion  to  those  convenient  indicators  on 
the  displays  of  systems  capable  of  exceed¬ 
ing  the  former  allowable  output  levels. 

These  indices  are  the  best,  usually  con¬ 
servative,  estimates  cunently  available  in 
real  time  of  the  possible  peak  temperature 
rise  (TI)  and  pi  (the  peak  negative  pres¬ 
sure  divided  by  the  square  root  of  the 
frequency,  or  MI).  When  users  inaease 
their  awareness  of  these  indicators  and 
employ  them  in  mental  risk-benefit  analy¬ 
ses  whenever  the  levels  are  high,  it  will  be 
less  likely  that  serious  damage  will  occur. 
It  would  also  be  possible  then  that  the 
limiting  guidelines  would  be  raised  or 
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removed  to  allow  additional,  relatively 
low-cost  improvements  in  diagnostic  in¬ 
formation  for  specific  examination  condi¬ 
tions  in  which  unusual  performance  is 
seriously  needed  or  actual  risk  is  lower 
than  would  be  assumed  from  the  simplest 
interpretation  of  the  displayed  indices. 

The  threshold  temperature  rise  for  tera¬ 
togenicity  in  animals  is  still  assumed  to 
be  near  1.5°C  (45),  while  TIb,  the  T1 
calculated  for  bone  surfaces,  at  the  maxi¬ 
mum  outputs  on  current  systems  is  as 
high  as  10.  Regarding  nonthermal  effects, 
small  areas  of  hemorrhage  have  been 
observed  at  tissue-air  boundaries  in  ani¬ 
mals  (lungs  and  intestines),  and  hemoly¬ 
sis  has  been  observed  with  bubble  con¬ 
trast  agents  in  mice  (46)  and  in  whole 
human  blood  in  vitro  (47).  With  the 
lowest  available  diagnostic  frequencies, 
around  2  MHz,  the  in  vivo  effects  have 
occuned  at  plf'^  near  the  maximum  al¬ 
lowed  and  employed  MI  value  of  1.9. 
There  are  no  known  adverse  nonthermal 
effects  in  vivo  from  US  exposures  in  which 
the  in  situ  value  of  plf'^  is  less  than  0.5 
MPa  •  MHz"°-^.  For  reasons  too  extensive 
to  list  here,  these  large  ratios  of  maxi¬ 
mum  employed  values  to  bioeffects 
thresholds  are  possible  without  known 
effects  in  humans.  The  most  important 
include  the  generally  conservative  design 
of  the  TI  and  MI  calculations  and  prob¬ 
able  rarity  of  use  of  maximum  outputs 
and  long,  continuous  exposure  to  key 
tissues  in  the  most  sensitive  situations. 
However,  there  are  situations  in  which 
the  TI  and  MI  are  probably  underesti¬ 
mates  of  the  exposures  and  tests  for  ef¬ 
fects  have  not  been  exhaustive.  For  the 
highest  practical  US  performance  and 
safety,  there  is  no  substitute  for  informed 
decisions  by  the  user. 

Other  Areas  of  Development 

There  are  several  other  areas  of  current 
development  and  future  promise.  These 
include  harmonic  imaging,  elastography, 
image  fusion,  telesonography,  virtual  ex¬ 
amination,  and  therapeutic  US. 

Harmonic  imaging,  mentioned  previ¬ 
ously  in  this  article,  was  initially  applied 
with  contrast  agents  to  increase  the  con¬ 
trast  between  the  blood  and  agent  combi¬ 
nation  in  a  vessel  and  the  surrounding 
tissue.  However,  it  has  been  observed  that 
second  harmonic  echoes,  emanating  from 
soft  tissues  from  well-known  nonlinear 
processes,  can  be  imaged  successfully.  Re¬ 
cent  experience  has  shown  that,  at  least 
in  some  cases  currently  described  as  "the 
difficult  patient,"  second  harmonic  imag¬ 
ing  can  improve  the  result.  The  images 
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appear  to  be  freer  from  artifactual  compo¬ 
nents,  and  structural  visualization  is  im¬ 
proved.  The  mechanisms  for  the  improve¬ 
ment  are  not  fully  understood,  but  the 
technique  could  be  expected  to  discrimi¬ 
nate  against  multiple-scattering  reverbera¬ 
tions  that  are  generated  before  the  focus 
and  thus  at  lower,  more  linear  pressure 
amplitudes.  The  same  applies  to  low- 
amplitude  side  lobes  and  general  clutter 
lateral  to  the  main  lobe  of  the  beam.  The 
extent  to  which  this  approach  will  be 
applicable  in  diagnosis  is  also  not  known. 
However,  it  appears  that  there  will  be  a 
role  for  this  technique  in  imaging  im¬ 
provement,  at  least  in  some  situations. 

Elastography  is  a  method  for  imaging 
the  elastic  or  hardness  properties  of  tis¬ 
sues  (48).  It  is  an  imaging  analogy  to  a 
physical  examination  searching  for  lumps 
by  touch.  With  use  of  cross-correlation 
techniques  to  determine  differences  in 
motion  of  adjacent  tissues  that  have  dif¬ 
ferent  compressibilities,  echo  data  are 
compared  before  and  after  a  slight  com¬ 
pression  with  the  transducer.  The  differ¬ 
ences  in  mechanical  properties  of  adja¬ 
cent  tissues  can  be  imaged  in  a 
conventional  two-dimensional,  cross- 
sectional,  gray-scale  marmer.  This  method 
provides  a  new  way  of  imaging  the  me¬ 
chanical  properties  of  tissues  and  holds 
promise  for  imaging  differences  between 
normal  and  abnormal  tissues  in  situa¬ 
tions  where  conventional  gray-scale  US 
does  not. 

Image  fusion  seeks  to  combine  images 
from  the  same  modality  (as  discussed 
above)  and  also  from  different  modalities 
(37).  These  combinations  may  provide 
diagnostic  information  of  greater  confi¬ 
dence  and/or  convenience  enhancing  the 
value  of  the  individual  modalities  in¬ 
volved. 

As  with  other  imaging  modalities,  US 
Information  transfer  between  scanning 
and  interpretation  sites  will  allow  for 
more  timely  and  efficient  usage  of  facili¬ 
ties.  Image  transfer  is  being  accomplished 
with  dedicated  lines,  phone  lines,  and  the 
Internet.  If  image  acquisition  becomes 
automated  (possibly  with  increased  feasi¬ 
bility  of  three-dimensional  image  acquisi¬ 
tion  with  two-dimensional  transducer  ar¬ 
rays)  it  may  even  become  possible  for 
"home  scanning"  by  the  patient  with 
communication  of  the  information  elec¬ 
tronically  to  the  interpreting  physician. 
This  "virtual  examination"  is  the  most 
speculative  suggestion  in  this  article,  but 
it  is  an  intriguing  possible  future  direc¬ 
tion  for  US. 

Although  the  primary  medical  uses  of 
US  are  in  diagnosis,  the  future  promises 


an  increased  role  for  US  in  intervention 
and  therapy.  In  addition  to  the  current 
use  of  US  for  biopsy  guidance,  US  is  a 
promising  method  for  the  guidance  of 
gene  therapy  in  solid  organs.  Ultrasound 
energy  is  also  being  investigated  as  a 
potential  method  for  activation  or  release 
of  therapeutic  agents  in  target  tissues, 
taking  advantage  of  mechanical  forces  to 
release  pharmaceuticals.  Highly  focused 
ultrasound  beams  are  capable  of  deliver¬ 
ing  large  amounts  of  thermal  energy  to 
small  targets  within  the  body  with  no 
damage  to  intervening  structures.  High- 
intensity  focused  ultrasound  is  capable  of 
highly  localized  tissue  destruction  by 
means  of  thermal  coagulation.  High- 
intensity  focused  ultrasound  tumor  de¬ 
struction  in  the  prostate  and  liver  may 
lead  to  relatively  noninvasive  percutane¬ 
ous  methods  for  definitive  or  palliative  treat¬ 
ment  of  primary  and  metastatic  tumors. 

Conclusion 

It  is  clear  that  US  will  remain  a  dy¬ 
namic  imaging  technology  in  the  foresee¬ 
able  future,  with  expanded  opportunities 
for  improving  patient  care  in  a  noninva¬ 
sive  and  cost-effective  fashion.  At  pre¬ 
sent,  it  appears  that  only  a  fraction  of  the 
potential  of  US  for  diagnosis  and  therapy 
has  been  realized.  Support  for  basic  and 
applied  research  is  critical  for  this  poten¬ 
tial  to  be  fully  realized.  Organizations 
such  as  the  American  Institute  of  Ultra¬ 
sound  and  the  Society  of  Radiologists  in 
Ultrasound  have  been  increasingly  in¬ 
volved  in  recent  years  in  identifying  and 
encouraging  research  initiatives  in  US. 
Because  of  the  opportunity  this  research 
provides  for  practical  and  useful  clinical 
effect,  federal  and  other  sources  of  fund¬ 
ing  should  be  provided  to  facilitate  the 
needed  research. 

Exciting  progress  in  US  technology  has 
tended  to  place  emphasis  on  the  perfor¬ 
mance  of  the  scanning  equipment  rather 
than  the  user.  It  is,  however,  essential  to 
recognize  the  fact  that  the  skill  and  expe¬ 
rience  of  the  sonographer  or  physician 
performing  the  examination  and  the  phy¬ 
sician  supervising  the  examination  and 
interpreting  the  images,  regardless  of  the 
equipment  used,  ultimately  determine  the 
benefit  of  US  in  patient  care.  To  realize 
the  promise  of  research  and  new  technol¬ 
ogy,  and  to  transfer  the  capability  of  new 
instrumentation,  contrast  agents,  arid  im¬ 
age  processing  to  radiologists  practicing 
US,  the  greatest  challenge  will  be  to  pro¬ 
vide  effective  education  and  training.  It  is 
in  this  role  that  the  American  Institute  of 
Ultrasound  in  Medicine  arid  the  Society 
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of  Radiologists  in  Ultrasound  have  a  great 
opportunity  to  contribute  to  the  success 
of  translating  the  research  of  today  into 
effective  clinical  practice  of  tomorrow. 
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INTRODUCTION 

Summary 

Three  dimensional  (3D)  ultrasound  images  provide  superior  visualization  of  anatomical 
features  than  two  dimensional  (2D)  power  mode  or  frequency  shift  color  Doppler  B-scan 
ultrasound  im^s.  However,  3D  daSta  sets  require  transducer  position  measurements  that  can 
be  problematic.  One  previously  investigated  approach  completely  automates  transducer 
positioning  and  measurements  with  one  dimensional  motorized  stages.  Other  system  types 
permit  full  six  degree-of-fieedom  (DOF)  manual  transducer  manipulation  while  measuring  all 
six  axes.  In  contrast  this  work  explores  die  middle  ground  of  measuring  the  two  degrees  of 
freedom  most  important  for  free-hand  scanning  while  fixing  the  remaining  axes  for  minimized 
complexity. 

The  device  designed,  fabricated,  and  tested  allows  Imear  motion  perpendicular  to  the  scan 
plane  and  along  the  beam  axis,  as  well  as  rotation  about  an  axis  parallel  to  the  array.  The 
measurement  system  is  designed  to  minimize  size,  weight,  and  cost  while  maximizing 
accuracy  and  ease  of  operator  use.  The  resulting  design  weighs  500g  in  its  heaviest 
configuration  and  is  150  mm  long,  64  mm  high,  and  70  nun  wide.  It  is  capable  of  0.1  mm 
accuracy  in  the  focal  plane.  Three  dimensional  data  with  continually  varying  translational  and 
rotary  ^eeds  was  interpolated  in  30  by  image  processing  software  to  minimize  distortion  in 
standard  Cartesian  coordinates.  Phantom  images  show  little  distortion  due  to  the  measuring 
system  or  data  processing  algorithm.  This  inexpensive,  compact,  and  lightweight  system 
interferes  minimally  with  clinician  free-hand  scanning  and  enhances  3D  image  collection  and 
generation  capabilities  in  the  clinical  setting. 

Three  Dimensional  Data  Acquisition 

The  goal  of  three  dimensional  ultrasound  imaging  has  been  pursued  by  a  number  of 
rese^h  laboratories.  Conventional  2D  ultrasound  images  are  inherently  limited  in  their  ability 
to  display  3D  human  anatomy  and  their  diagnostic  usefulness  is  thus  reduced.  A  number  of 
laboratories  have  investigated  various  methods  of  attaining  the  critical  transducer  position 
measurements  to  create  3D  data  sets.  A  common  feature  of  many  of  these  imaging  systems  is 
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METHODS 

Instrumentation  System  Overview 

The  3D  ultrasound  data  acquisition  system  is  comprised  of  three  major  parts.  First  is  the 
ultrasound  imaging  system.  The  scanning  data  presented  was  gathered  by  a  General  Electric 
Logiq  700  MR  machine  with  a  739L  transducer  but  the  design  is  equally  applicable  to  other 
machine  types.  Second  is  the  personal  computer  which  handles  data  acquisition  and  storage. 
The  current  experiments  collect  position  data  at  the  same  fixed,  4  Hz  rate  as  the  production  of 
ultrasound  B-scan  images.  Ih  future  experiments,  the  personal  computer  will  store  B-scans  at 
desired  spatial  increments  through  sisals  to  the  cardiac  gating  feature  of  the  ultrasound 
machine.  For  color  flow  studies  of  maximum  sensitivity,  cardiac  signals  will  trigger 
ultrasound  image  storage  and  simultaneous  position  measurements  by  the  personal  computer. 
The  third  major  component,  and  the  focus  here,  is  the  mechanical  transducer  guiding  system 
and  its  translation  and  rotation  sensors.  Postprocessing  for  3D  image  construction  is 
performed  on  a  Digital  Equipment  Corporation  Alpha  workstation. 

System  Design  of  the  Guide  and  Measurement  System 

The  overall  goal  of  allowing  natural,  free-hand  transducer  motion  in  2  DOF  while 
measuring  translation  and  rotation  drove  the  design  of  the  measurement  system.  This  goal 
requires  a  compact  device  that  allows  natural  grasp  of  the  transducer  grip.  The  device  must 
not  provide  too  much  friction  or  require  movement  of  significant  mass.  It  should  provide 
range  of  motion  greater  than  required  for  screening  examinations.  The  device  must  have  low 
overall  mass  to  maximize  patient  comfort.  The  accuracy  and  linearity  must  be  high  so  that 
these  factors  contribute  little  additional  distortion  to  the  3D  image.  Finally  it  should  be 
inexpensive.  These  factors  all  influenced  the  design  described  below. 

Figure  1  shows  the  design  developed  by  this  program  that  provides  transducer  guidance 
and  measurement.  The  design  uses  a  "series”  design  where  multiple  DOF  are  created  by 
selecting  a  base  motion  type  and  installing  the  other  DOF  on  the  now  moving  base  stage,  hi 
the  device  described  here  the  base  stage  provides  translation.  This  is  advantageous  because  of 
the  large  stroke  required.  The  alternative  of  mounting  the  translation  stage  on  the  rotary  axis 
would  be  very  clumsy  because  of  the  large  radius  of  the  resulting  rotating  mass.  For  to 
reason  the  rotation  stage  is  mounted  on  the  translation  carriage.  Finally  a  second  translation 
stage  is  mounted  on  die  rotating  shaft  to  provide  the  third  DOF.  The  first  two  DOF  are 
measured  however  the  third  is  not  but  could  be  instrumented  using  straightforward  metho^. 
This  third  DOF  can  be  locked,  or  left  free  when  positional  accuracy  is  not  critical,  e.g.  while 
following  rough  surface  contours. 

The  major  components  shown  in  Figure  1  are  described  below  beginning  with  those 
components  nearest  the  patient  At  the  base  is  a  stabilizing  platform  made  of  acrylic  sheet  with 
a  window  for  transducer  array  access  to  the  skin.  The  material  is  clear  for  ease  of  positioning, 
has  low  thermal  conductivity  for  patient  comfort,  and  is  easily  cleanable. 

Mounted  horizontdly  on  the  base  plate  is  a  Thompson  Series  10  miniature  linear 


computer  controlled,  motor-driven  linear  ultrasound  transducer  motion  (Pretorius  et  a].,  1992, 
Picot  et  al.,  1993,  Moskalik  et  al.,  1995,  Tong  et  al.,  1996,  and  Hernandez  et  al.,  1996)^ 
These  designs  give  precise  control  of  the  ultrasound  transducer  position,  usually  with  one' 
degree-of-freedom.  However  these  motorized  systems  frustrate  the  clinician's  desire  for  the 
flexibility  of  conventional  hand-controUed  ultrasound  examinations.  Free-hand  control 
facilitates  localizing  a  specific  region  of  interest  (ROI),  especially  when  examining  organs  of 
convex  or  concave  external  shape  such  as  the  shoulder,  the  uterus,  and  the  liver  near  the  ribs. 

fri  contrast,  other  studies  have  provided  complete  freedom  of  motion  for  manual 
examinations  while  measuring  the  positions  of  each  of  the  6  axes  of  motion,  both  translation 
and  rotation  (  Detmer  et  al.,  1994,  Kelly  et  al.,  1994,  Nelson  and  Pretorius,  1995,  and 
Hughes  et  al.,  1996).  Such  systems  are  often  less  accurate  and  may  be  complex,  large,  and 
more  costly.  The  approach  of  the  present  work  uses  an  intermediate  approach  with  manual 
transducer  control  only  in  the  degrees-of-freedom  that  are  most  helpful,  while  avoiding 
complete  6  DOF  freedom  of  motion  that  increases  complexity  and  cost.  The  current  design 
measures  2  DOF  and  can  be  easily  retrofitted  for  measurement  of  the  third  axis,  which  is  a 
second  translation  axis. 


bearing.  This  bearing  provides  motion  of  the  transducer  in  the  z  axis  which  is  defined  to  be 
perpendicular  to  the  long  dimension  of  the  ultrasound  array  (x  axis). 


Figure  1.  The  ultrasound  transducer  guide  and  measurement  system  (drawing  by  Ben  Moskalik). 


Low  friction  is  provided  by  the  light  rather  than  heavy  preload  on  the  bearings,  and  by  the  use 
of  low  friction  bearing  seals.  Preload  is  required  to  minimize  backlash,  particularly  in  the  roll 
axis.  Waterproof  ^ease  such  as  petroleum  jelly  excludes  gel  and  cleaning  water  from  the 
bearing  interior  while  being  nontoxic  to  the  patient 

Parallel  to  the  linear  bearing  and  also  mounted  on  the  base  plate  is  a  precision  linear 
potendometer.  This  off-the-shelf  Duncan  Electronics  400  Series  potentiometer  uses  a  high 
linearity  conductive  plastic  film  and  has  dual,  parallel  wipers  to  reduce  noise.  TIris 
potentiometer  measures  the  translation  of  the  ultrasound  array  by  providing  a  voltage  output 
when  a  reference  voltage  is  applied  to  the  resistive  element.  The  ffiction  and  damping  of  the 
wiper  is  adjustable  by  removal  of  plastic  inserts.  The  wiper  access  slot  has  rubber  seals  that 
face  the  side  to  avoid  gel  and  water  intrusion.  This  sensor  has  the  advantage  of  providing  an 
analog  output  which  simplifies  development  of  interfaces  to  various  laboratory  instruments 
during  system  development  and  experiments.  Minimal  distortion  of  the  interpolated  three 
dimension  model  of  the  tissues  requires  low  position  noise  and  high  accuracy.  These 
important  potentiometer  parameters  were  measured  with  results  presented  at  the  end  of  this 
section. 

The  capacity  to  rotate  the  transducer  array  around  an  axis  parallel  to  the  array  (x  axis)  is 
provided  by  a  rotary  optical  encoder  mounted  onto  the  linear  bearing  carriage.  This  optical 
encoder  integrates  the  functions  of  a  rotary  bearing  and  rotary  sensor.  If  separate  components 
were  used  instead  and  connected  by  a  belt,  for  example,  bacldash  and  calibration  errors  would 
be  much  larger.  The  RIS15  encoder  from  BEI  Encoder  Systems  Division  is  used  and  has 
^00  lines  on  the  disk,  thus  supplying  8,000  counts  per  turn  using  quadrature  electronics. 
This  disk  resolution  supplies  angle  precision  of  0.045  degrees  or  linear  precision  of  0.075  mm 
at  50  nim  below  the  slon.  The  internal  encoder  bearings  provide  22N  (5  Ibf)  load  capability 
which  is  sufficient  to  support  the  transducer  and  normal  operator  hand  forces.  An  analog 
output  is  provided  for  simplicity  of  interface  thus  avoiding  software  intensive  seri^ 
communication. 

A  major  goal  of  this  effort  is  miniaturization  of  the  measurement  system.  The  resulting 
design  weighs  650g  including  the  ultrasound  transducer.  This  mass  is  divided  into  stationary 
parts  weighing  190  g,  which  includes  the  base  plate,  potentiometer,  and  linear  bearing  rail. 
The  moving  parts  weigh  460  g  which  includes  a  typical  140  g  ultrasound  transducer,  an 
optical  encoder  weighing  170  g,  a  vertical  linear  bearing  weighing  30  g,  and  various  brackets. 

The  length  of  the  package  along  the  translation  (z)  axis  is  153  mm,  and  the  width  (x 


axis)  is  142  mm  parallel  to  the  transducer  array.  The  height  (y  axis)  without  a  ultrasound 
transducer  installed  is  64  mm  to  the  top  of  the  optical  encoder  body.  The  device  fits  into  a 
rectan^ar  prism  of  1400  cc.  In  the  configuration  illustrated  the  translational  range  is  70  mm 
which  is  easily  expandable. 

Translation  Sensor  Linearity  and  Noise  Measurements 

Poor  linearity  and  contact  noise  are  traditional  weaknesses  of  potentiometers.  The 
potentiometer  was  selected  for  the  final  design  because  of  the  advantages  of  size  and  weight 
over  competing  linear  optical  encoders,  but  oriy  after  complete  testing  of  linearity  and  noise. 

Linearity  was  measured  by  translating  the  potentiometer  wiper  with  a  lead  screw  and 
measuring  the  potentiometer  wiper  voltage  with  a  constant  voltage  applied  to  the  resistive 
element.  The  voltage  was  read  by  a  12  bit  analog-to-digital-converter  (ADC)  board  that  was 
also  used  for  the  phantom  and  clinical  data  presented  in  the  Results  Section.  This 
experimental  protocol  tests  the  linearity  of  the  ADC  as  well  as  the  potentiometer.  The  error  of 
the  digital  position  measurement  was  calculated  from  the  best  linear  model  of  the  data  using  a 
least  mean  square  algorithm.  The  worst  cumulative  error  is  0.47  mm  or  0.68  percent.  By 
avoiding  the  &st  2  mm  of  the  69  mm  stroke  the  nonlinear  error  can  be  limited  to  0.35  percent. 
It  is  important  to  note  that  the  maximum  nonlinear  error  between  successive  0.5  mm  slices  is 
limited  to  0. 16  mm  or  32  percent  of  the  slice  spacing.  This  implies  that  the  greatest  distortion 
using  this  potentiometer  would  be  one  ttod  of  a  space  between  scan  planes.  Further 
improvement  in  linearity  is  available  in  high  linearity  (0.1%)  potentiometers,  available  from  the 
manufacturer. 

The  electrical  noise  of  the  translational  sensing  system  was  also  measured  during  a 
typical  slew  maneuver  of  1  mm  per  second.  Resistance  changes  as  the  wipers  slid  across  the 
conductive  film  were  determined  as  well  as  noise  from  the  cabling  and  ADC  circuitry.  Figure 
2  shows  the  calculated  position  during  slewing.  The  primary  feature  of  the  plot  is  the  series  of 
steps  due  to  the  quantization  size  of  the  12  bit  ADC  circuit  The  resistor  output  voltage  is  10  V 
for  a  100  mm  range.  This  is  processed  by  a  12  bit  ADC  having  4096  steps  and  an  input  range 
which  is  also  10  V.  The  result  is  quantization  steps  of  2.4  mV,  or  0.024  mm,  for  die  stated 
position  and  voltage  ranges.  Figure  2  shows  that  this  quantization  noise  dominates  the 
calculated  transducer  position.  Potentiometer  noise  is  small  relative  to  the  ADC  quantization 
error  and  is  insignificant  for  this  plication. 
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Figure  2.  Electrical  noise  during  slewing  of  the  plastic  film  linear  sensor. 


results 

The  goal  of  the  program  is  construction  of  a  measurement  system  that  provides  linear 
,  -ntary  position  of  the  ultrasound  transducer.  The  ultimate  goal  for  this  data  is  the 
^^truction  of  3D  data  sets  where  any  2D  image  section  can  be  presented  to  the  viewer 
'  *^°thout  significant  distortion.  Real-time  measurements  avoid  the  need  for  evenly  spaced  B- 
bec^se  the  3D  image  processing  software  can  accomodate  the  varying  slice  spacing. 
T^ear  interpolation  is  used  to  assign  weighted  fractions  of  the  raw  image  data  into  the 
desired  3  D  grid.  A  raw  3D  data  set  was  created  from  scans  of  a  filament  phantom.  A  single 
:  g,scan  was  used  as  a  reference  image  and  a  similar  section  of  the  interpolated  3D  data  was 

ev^uated  for  distortion. 

The  first  step  in  this  evaluation  was  creation  of  a  reference  2D  B-scan  image  of  the 
p^i^ntnTTi.  The  B-scan  was  taken  perpendicular  to  the  phantom  filaments  for  finest  detail  and 
{pinimal  sensitivity  to  precise  transducer  alignment  This  2D  image  is  shown  in  Figure  3.  ■ 

A  3D  data  set  was  created  from  a  set  of  B-scans  taken  parallel  to  the  phantom  filaments, 
i.e..  perpendicular  to  the  reference  2D  scan.  Motion  was  allowed  in  both  translation  and 
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F^ore  3.  Reference  B-scan  perpendicular  to  the  phantom  filaments. 


Figure  4.  An  image  from  the  3D  data  set  after  interpolation  for  rotation  and  uneven  spacing. 
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rotation.  Figure  4  shows  an  image  reconstructed  from  the  3D  data  set  after  interpolation  based 
on  the  measurement  system.  Data  from  each  scan  plane  was  placed  into  the  nearest  Cartesian 
grid  vertices  using  trilinear  interpolation.  The  figure  shows  how  the  features  from  Figure  3 
are  presented  with  an  acceptable  level  of  distortion.  Note  that  the  lateral  boundaries  the  image 
are  not  parallel  and  thus  accurately  reflect  the  degree  of  rotation  employed  during  the  3D  data 
collection. 

Figure  4  shows  some  degradation  in  image  quality  due  to  reduced  resolution.  This 
effect  resiSts  from  the  different  precision  of  beam  focusing  between  the  in-plane  and  out-of- 
plane  directions.  Electronic  focusing  within  the  B-scan  plane  provides  better  focusing,  and 
also  high  depth  of  field  through  changes  in  focus  depth.  In  the  elevational,  or  out-of-plane 
direction  used  by  the  3D  software  to  reconstract  objects  perpendicular  to  the  constituent  B- 
scans,  single  array  elements  provide  poorer  focusing.  The  resulting  3D  image  is  smeared  in 
the  franslation  direction  because  of  the  large  elevational  beam  width.  The  3D  image  shown  is 
provides  the  most  severe  conditions  for  comparison  of  B-scan  and  3D  data. 


CONCLUSIONS 

This  work  has  developed  a  small,  low  cost  ultrasound  transducer  position  measuring 
system  that  minimally  affects  the  clinician’s  preferred  technique  during  ultrasound 
examinations.  Manud  examination  is  facilitated  by  permitting  varying  speeds  of  translation 
while  still  producing  low  distortion  3D  image  sets.  Patient  comfort  is  maximized  by  the 
device's  light  weight  wMe  its  small  size  permits  access  to  a  range  of  body  regions  comparable 
to  the  ultrasound  transducer  alone.  Measurement  of  the  two  axes  critical  to  image  acquisition 
flexibility  is  provided  while  motion  in  other  axes  is  prohibited,  thus  simplifying  measurement, 
data  acquisition,  and  image  processing. 
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Abstract 

The  purpose  of  this  article  is  to  demonstrate  evaluation  techniques  of  3D  ultrasound  imaging  and  their  growing  utility  in  the 
discrimination  and  assessment  of  breast  cancer.  Our  ongoing  studies  include  women  with  mammographically  ob^served  breast 
masses  scheduled  for  biopsy.  During  ultrasound  imaging  of  suspicious  breast  lesions,  transducer  position  is  encoded  for  each 
power  mode  and  frequency  shift  color  Doppler  image  (p-CDI  and  f-CDI)  as  well  as  each  standard  B-mode  image,  typically  90 
images  in  each  mode.  Vessels  are  then  displayed  as  reconstructed  color  volumes  in  3D,  superimposed  on  gray  scale  sUces. 
Radiologists  identify  suspicious  masses  and  rate  their  appearance  for  conventional  gray  scale  and  new  vascular  criteria.  In  an 
initial  patient  population,  ultrasound  discrimination  of  malignant  masses  in  3D  volumes  demonstated  superiority  over  its  2D 
counterpart.  In  the  related  patient  group  presented  in  this  article,  one  particular  vascularity  measure,  S  peed  W  eighted  Pixel 
Density  (SWD),  shows  statistically  different  (p<0.001)  values  for  benign  (n=13)  versus  mahgnant  (n=15)  cases.  Given  our  modest 
success  in  discriminating  breast  cancer  in  an  initial  patient  pool  with  o^er  vascularity  measures,  results  of  this  second  patient 
population  continue  to  suggest  vascularity  as  a  potential  cancer  discriminator. 
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Introduction 

Subjective  assessment  of  ultrasound  Doppler  imaging  may  be  enhanced  by  more  quantitative  analyses.  Displaying  vascularity  in 
3D  is  relatively  simple,  as  the  image  segmentation  is  performed  by  the  color  flow  imaging  system,  and  sparse  vascular  patterns  are 
easUy  appreciated  in  3D.  A  number  of  investigators  (1-4)  have  done  a  good  job  of  semiquantitative  evaluation  of  color  flow  image 
characteristics  of  the  breast;  however,  it  may  be  difficult  to  objectively  sample  the  sparse  breast  vasculature  throughout  the  tumor 
volume  in  totally  free  hand  2-D  sampling.  Stavros,  et  al.  have  achieved  very  promising  results  in  the  evaluation  of  breast  cancer 
using  a  multivariable  gray-scale  assessment  of  2D  imaging  (5,6).  Cosgrove  and  Lees  also  indicated  that  the  addition  of  color  flow 
Doppler  to  B-mode  improved  the  diagnostic  accuracy  by  an  amount  approximately  equal  to  the  benefit  of  adding  ultrasound  to 
mammography.  They  quote  that  the  chance  of  malignancy  after  workup  must  be  <2%  to  consistently  avoid  biopsy  (7). 

Based  on  the  potential  benefits  of  combining  3D  sampling  and  quantitative  assessments,  a  preliminary  study  was  performed  to 
evaluate  which  Doppler  signals  might  provide  discrimination  of  breast  cancer  fiom  benign  masses  and  to  compare  2D  and  3D 
ultrasound  display  modes.  The  amount  of  blood  flowing  as  indicated  by  power  mode  color  Doppler  imaging  (p-CDI)  (8)  and 
velocity  indicated  by  mean  frequency  color  Doppler  ima^g  (f-CDI)  both  lend  themselves  to  quantitative  measures  (9).  To 
evaluate  information  provided  in  these  measures  and  to  aid  visual  assessment,  we  undertook  a  visual  and  digital  analysis  of 
information  in  a  study  including  3D  ultrasound  examinations  of  20  breast  patients  scheduled  for  breast  biopsy  and  have 
subsequently  analyzed  examinations  on  28  patients  obtained  with  a  different  scanner.  3D  breast  lesion  image  volume  acquisition 
techniques  and  visualization  schemes  are  presented  here  in  general,  and  a  particular  vascularity  measure  (Speed  Weighted  Pixel 
Density)  measured  in  each  of  4  regions  of  interest  in  and  around  the  mass  is  compared  to  standard  gray  scale  criteria  for  this 
current  patient  pool. 
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In  an  early  study,  quantitative  measures  were  calculated  for  20  different  subjects  (10).  Nine  masses  were  malignant,  four  were 
fibroadenomas,  and  seven  were  other  benign  masses.  Each  exam  consisted  of  one  or  more  power  mode  3D  scans  and  a  frequency 
shift  3D  scan  of  the  mass  and  the  surrounding  tissue.  The  3D  scans  in  these  clinical  trials  analyzed  were  acquired  using  the  system 
described  in  (9) .  This  system  consisted  of  a  conventional  ultrasound  scanner  (Spectra  VST,  Diasonics,  Inc.,  Milpitas,  CA),  a 
modified  mammography  unit  which  applied  mild  compression  to  stabilize  the  breast  and  a  motorized  transducer  positioner 
mounted  to  the  mammography  unit.  At  the  6  MHz  Doppler  frequency  of  our  6-10  MHz  linear  array,  signals  produced  in  the  two 
color  flow  modes  were  measured  to  quantitatively  estimate  vascularity  features  in  various  3D  regions  of  interest  (ROIs)  in  and 
around  the  suspicious  masses.  Click  here  to  see  an  early  example  of  a  dynamic  display  technique  we  employed  (11).  Observers  in 
the  earher  study  judged  the  3D  displays  to  be  superior  to  recorded  2D  images,  particularly  for  assessment  of  amount  and 
morphology  of  vascularity  (H).  Based  on  these  prior  experiences,  we  continued  3D  ultrasound  scanning  with  the  modifications 
noted  below. 

Image  Acquisition 

The  examples  shown  in  subsequent  sections  were  obtained  with  a  new  hand  held  scanner  (12)  and  a  7.5  MHz  linear  or  12  MHz 
array  scanhead  (Logiq  700,  GE  Medical  Systems.  Milwaukee,  WI).  Acquisition  of  3D  ultrasound  volumes  is  achieved  with  a  step 

size  between  scan  planes  typically  0.5  mm  for  the  50-120  images  per  scan,  covering  a  volume  typically  35  x  45  x  45  mm  .  Power 
mode  images  (p-CDI)  are  set  to  maximize  sensitivity  to  small  vessel  flow,  while  frequency  shift  (f-CDI)  settings  are  a  compromise 
between  slow  flow  detectabihty  and  aliasing.  Each  Doppler  image  acquired  is  software  triggered  externally  by  a  cardiac  gated 
computer  interface,  which  also  records  transducer  position  and  provides  operator  scan  speed  feedback. 

The  Scanning  Apparatus 

The  hand-controlled  transducer  fixture  device  is  designed  to  provide  guided  trajectory  of  the  transducer  while  measuring  the  two 
spatial  variables,  linear  position  and  rotation  angle  as  shown  in  Figure  1 .  Mounted  on  the  base  platform  is  a  miniature  linear 
bearing  which  enables  motion  of  transducer  in  the  x-axis,  perpendicular  to  the  ultrasound  array.  Behind  the  linear  bearing  and  also 
mounted  onto  the  base  plate  is  a  precision  linear  potentiometer.  The  translation  of  the  transducer  linearly  changes  the  resistance  of 
the  potentiometer,  ultimately  providing  an  output  potential  to  our  computer  interface  proportional  to  scan  head  position. 
Resolution  of  the  linear  encoder  is  dictated  by  A/D  quantization,  in  this  case  corresponding  to  a  distance  of  18  microns.  A  light 
weight  rotary  optical  encoder  provides  angular  measurement,  via  a  quadurature  decoder  (designed  and  built  in-house)  and 
software  interface,  providing  an  angular  resolution  of  0.04  degrees.  A  window  in  the  base  plate  allows  scan  head  contact  with  the 
patient. 
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Figure  1.  (a)  Schematic  representation  of  the  hand  scan  apparatus,  (b)  The  actual  mechanism. 


Post-Acquisition 

Data  is  transferred  from  the  GE  ultrasound  scanner  to  a  DEC  Alpha  workstation,  where  individal  slice  planes  are  cropped  and 
"stacked"  together  to  form  a  3D  volume.  From  the  3D  image  volume  set,  vessels  from  ultrasound  scans  are  displayed  as  color 
volumes  in  3^D,  superimposed  on  gray  scale  slices,  for  the  identification  of  suspicious  masses.  Our  visualization  software  and 
related  processing  modules  facilitate  3D  viewing.  Presently,  the  clinician  is  able  to  position,  tilt,  scale  and  adjust  all  axes  of  a 
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"d^ftaifuc"  ellipsoid  which  is  selected  based  on  the  gray  scale  borders  of  the  suspicious  mass.  This  radiologist  defined  ellipsoid 
(FDE)  serves  as  the  point  of  reference  for  all  other  regions  of  interest,  as  described  below.  Most  of  the  other  regions  of  interest  are 
actually  defined  by  the  clinician's  selection.  For  the  quantitative  analysis  of  vascularity,  the  methods  described  in  ('9.101  are 
employed.  Quantities  such  as  those  described  in  (9.101  are  presented  in  Table  1  and  are  calculated  for  each  of  the  four  regions  of 
interest  (ROIs)  defined  in  Table  2 .  Also,  visud  gray  scale  features  are  evaluated  on  a  5  point  scale,  averaged,  and  used  for 
comparison  with  vascularity. 


PD 

Power  Weighted  Pixel  Density 

PD^ 

f=l 

NMPCP 

Normalized  Mean  Power  In  Colored  Pixels 

P- 

NPD 

Normalized  Power  Weighted  Pixel  Density 

SWD 

Speed  Weighted  Pixel  Density 

f^h 

5WD= 

i=l 

V 

Mean  Speed  in  Colored  Pixels 

i=l 

SNPD 

Speed  and  Power  Weighted  Normalized  Pixel 
Density 

SNPD-  S 

Table  1.  Ultrasound  vascularity  measures  and  their  formulas.  Nb  is  the  number  of 
pixels  with  flow  in  them  and  Nt  is  the  total  pixels  in  the  region  of  interest.  Pi  is  the 
power  Doppler  value  of  the  ith  pixel  and  Vi  is  the  Doppler  speed  value  of  the  ith 
pixel.  This  measurement  of  speed  is  calculated  from  the  mean  frequency  shift  value 
assuming  an  isotropic  distribution  of  vessels,  because  no  directional  information  is 
obtained.  Pb  is  the  estimated  power  value  in  100%  blood  at  the  depth  of  the  ith  pixel. 


1.  Lesion:  normally  from  the  outer  gray  scale  border  up  to  1  cm  inside. 

2.  Lesion,  proximal  side  only:  (hemi-ellipsoidal  version  of  region  1). 

3.  External  periphery:  mass  gray  scale  boundary  up  to  1  mm  outside. 

4.  External  periphery,  proximal  side  only;  (hemi-ellipsoidal  version  of  region  3). 

Table  2.  List  of  the  four  3D  regions  of  interest  (ROIs)  associated  with  the  mass  and  used  in  the 
quantitative  analysis  of  vascularity. 
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Analysis  of  Clinical  Results 


Scatter  plots  of  NPDmax  and  [(vm)(NPDmax)]  vs.  Average  Visual  Gray  Scale  Rating  (l=normal  to  5=highly  suspicious)  were 
evaluate  for  each  subject  in  the  previous  study  (10).  All  &e  points  for  malignant  masses  formed  a  cluster  with  higher  values  of 
quantitative  vascular  measures  and  gray  scale  rating  as  hypoAesized.  Discriminant  analysis  on  cancer  versus  aU  benign  masses 
provided  a  classification  with  sensitivities  of  100%  and  specificities  of  82%  and  90%,  for  NPDmax  and  [(v  m  )(WDmax)], 
resj^tively,  when  combined  with  gray  scale  ratings.  These  specificities  were  higher  than  for  gray  scale  rating  alone,  but  the 
statistical  uncertainty  in  these  numbers  is  large.  Our  second  patient  pool  is  aimed  at  adding  greater  statistical  significance  to  these 
values  and  explore  possible  other  quantitative  measures.  Figure  4  demonstrates  one  such  measiue.  Speed  Weighted  Pixel  Density 
(SWD  as  described  in  Table  2).  It  is  mathematically  equivalent  to  pixel  density  times  the  average  velocity,  and  thus  similar  to 
[(vm)(NPDmax)]  without  the  power  weighting.  SWDmax  refers  to  the  the  maximum  or  peak  SWD  value  calculated  in  the  4 
regions  described  in  Table  1 .  As  shown  in  the  figure,  the  mean  value  of  log(SWDmax)  is  significantly  different  for  the  benign 
versus  malignant  groupings  (p<0.001  that  the  means  are  equal). 


Figure  4.  Plot  of  the  mean  peak  log(SWD)  for  benign  versus  malignant  breast  lesions.  The  probability  that  the  means  of  these 
sub-groups  are  different  showed  statistical  significance  (p>0.999). 

Comparative  Results 

ROC  analysis  was  performed  on  the  SWD  measure  and  average  gray  scale  rating  using  ROCKIT  software  provided  by  the 
University  of  Chicago  Department  of  Radiology  (fixam  the  current  versions  of  an  ROC  so^are  package  developed  by  Professor 
Charles  Metz  and  his  colleagues).  Figure  5  demonstrates  the  predictive  similarity  between  the  SWD  measure  and  die  average 
gray  scale  rating  (GS).  The  graph  on  the  left  shows  the  raw  data  and  ROC  curve  fit  for  both  measures.  On  the  right,  the  95% 
coiifindence  intervals  for  these  measures,  give  a  subject  pool  of  28  patients.  The  Az  values  calculated  for  SWD  and  GS  were 
comparable,  0.88  and  0.84,  respectively. 
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ROC  Aiiftlysis 


Figure  5.  (Top)  Calculated  true  positive  fractions  (TPF)  versus  false  positive  fractions  (FPF)  of  log(SWDmax)  and  average 
gray  scale  rating  (GS)  for  our  28  patient  population.  Overlayed  are  smooth  calculated  ROC  curves.  (Bottom)  Calculated  ROC 
curves  with  their  respective  95%  confidence  intervals  for  the  same  measures  as  on  the  left. 
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jCondusions 

Our  data  transfer,  processing,  and  visualization  tools  have  been  developed  to  the  point  where  full  3D  volumes  and  vascularity 
isosurface  mappings  can  be  reviewed  within  an  hour  of  the  ultrasound  exam  itself.  These  developments  have  facihtated  the 
visualization  of  vascular  morphology  as  well  as  an  ease  in  scanning  through  entire  ultrasound  volume  sets  from  different 
perspectives.  In  addition,  we  have  provided  the  radiologist  with  a  straightforward  method  for  defining  reproducible  ROI  ellipsoids 
within  a  given  ultrasound  volume  which  facihtates  a  variety  of  quantitative  measures.  As  demonstrated  by  ROC  analyses,  these 
objective  measures  of  vascularity  (most  recently  SWD)  in  and  of  themselves  have  been  shown  to  be  as  effective  as  subjective  gray 
scde  measures  for  our  current  patient  population. 

Given  these  observations,  we  beUeve  that  vascularity  should  improve  the  discrimination  of  benign  and  malignant  soUd  masses  by 
ultrasound  and  that  the  results  are  probably  generalizable  to  different  scanners.  Larger  numbers  of  subjects  and  improved  ease  of 
performance  of  good  vascularity  exams  are  now  needed  to  allow  good  judgements  of  the  achievable  diagnostic  accuracy  and  cost 
effectiveness  of  adding  vascularity  to  clinical  ultrasound  assessments  of  breast  masses.  Ease  of  performance  is  well  on  its  way,  with 
advances  occurring  rapidly  in  3D  scanning,  image  analysis  and  display.  If  p-CDI  data  (e.g.  NPDmax)  and  f-CDI  measures  (e.g. 
SWDmax)  each,  separately,  continue  to  perform  comparable  to  gray  scale  measures  and  almost  as  well  as  the  power  and  color 
flow  mode  combination  required  for  log[(Vm)*(NPDmax)]  as  demonstrated  in  our  earUer  report  (9),  then  one  of  the  two  color  flow 
3D  scans  can  be  eliminated  to  speed  the  entire  process.  Alternatively,  the  ultrasound  system  manufacturer  could  supply  the  p-CDI 
and  f-CDI  signals  simultaneously  with  sufficient  signal  dynamic  range  for  accurate  assessments  of  the  perfusion-hke 
log[(Vm)*(NPDmax)]  on  a  pixel  by  pixel  basis.  For  imaging  vessel  patterns,  httle  would  be  lost  by  requiring  the  same  system 
settings  for  both  f-CDI  and  p-CDI  modes  in  a  single  image. 

The  possible  utility  of  vascularity  measures  is  strengthened  by  the  success  (Figures  4  and  5)  of  the  f-CDI  measure  SWD  in 
discriminating  malignant  from  benign  masses  with  tiie  most  recent  data  from  the  GE  M12,  8-11  MHz,  1.5D  matrix  array.  SWD 
was  not  the  most  successful  measure  in  the  original  Diasonics  data,  but  possible  utihty  was  shown  witii  SWD.  If  that  trend 
observed  in  the  matrix  array  data  continues,  there  may  not  be  a  need  to  perform  the  more  difficult,  multiregion,  NPDmax  and 
log[(Vm)*(NPDmax)]  examinations  and  measurements. 

Gray  scale  readings  were  performed  by  a  radiologist,  highly  experienced  in  breast  imaging  and  ultrasound.  If  vascularity  measures 
on  simple  regions  of  interest  can  perform  at  least  as  well  as  gray  scale  with  the  experience  reader,  then  the  potential  for  use  of 
vascularity  in  improving  routine  diagnosis  is  high. 

In  summary,  our  modest  success  in  discriminating  breast  cancer  in  an  initial  patient  pool  with  other  vascularity  measures  and  the 
results  of  this  second  patient  population  continue  to  suggest  vascularity  as  a  potentid  cancer  discriminator.  Our  visualization  and 
quantization  tools  should  continue  to  facilitate  this  process. 

[  Previous:  Clinical  Discrimination  Results  ]  [  Next:  References  ] 
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